-- Logs begin at Wed 2021-11-24 17:04:45 UTC, end at Wed 2021-11-24 18:43:11 UTC. -- Nov 24 17:41:30.082241 dv-cinder-818579-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 17:41:30.092454 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 17:41:30 2021] *** Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: nodename: dv-cinder-818579-1-iscsi Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: machine: x86_64 Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: clock source: unix Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: pcre jit disabled Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: detected number of CPU cores: 4 Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: current working directory: / Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: detected binary path: /usr/bin/uwsgi-core Nov 24 17:41:30.095016 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: your processes number limit is 47680 Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: your memory page size is 4096 bytes Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: detected max file descriptor number: 2048 Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: lock engine: pthread robust mutexes Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: thunder lock: enabled Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 17:41:30.095769 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 17:41:30.136997 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: Python main interpreter initialized at 0x5573ae2459c0 Nov 24 17:41:30.136997 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: python threads support enabled Nov 24 17:41:30.136997 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: your server socket listen backlog is limited to 100 connections Nov 24 17:41:30.136997 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: your mercy for graceful operations on workers is 90 seconds Nov 24 17:41:30.137357 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 17:41:30.137440 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: *** Operational MODE: preforking *** Nov 24 17:41:30.137650 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: *** uWSGI is running in multiple interpreter mode *** Nov 24 17:41:30.137650 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: spawned uWSGI master process (pid: 86151) Nov 24 17:41:30.137849 dv-cinder-818579-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 17:41:30.138922 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: spawned uWSGI worker 1 (pid: 86152, cores: 1) Nov 24 17:41:30.138922 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: spawned uWSGI worker 2 (pid: 86153, cores: 1) Nov 24 17:41:30.138922 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 17:41:34.217051 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 17:41:34.217822 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 17:41:34.217822 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 17:41:34.218094 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 17:41:34.218342 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 17:41:34.218709 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 17:41:34.219138 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.219231 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 17:41:34.219328 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.219328 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.219489 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 17:41:34.219654 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.219794 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 17:41:34.219982 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.220078 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 17:41:34.220290 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.220421 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.220604 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.220746 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.220923 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221067 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221244 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221384 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221499 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221715 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.221820 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222026 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222131 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818579-1-iscsi {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222344 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222429 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222662 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222760 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.222992 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223099 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223247 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223346 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223557 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.223907 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224009 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818579-1-iscsi {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224206 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224300 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224516 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224700 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.224827 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225143 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225269 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225449 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225542 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225753 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.225852 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226055 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226174 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226378 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226559 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226668 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.226872 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227038 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227177 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227272 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227484 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227576 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227858 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.227954 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228172 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228264 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818579-1-iscsi {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228479 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228570 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228782 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.228879 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.229091 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.229186 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230043 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230448 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230566 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230721 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230809 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230891 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818579-1-iscsi {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.230970 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231057 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231197 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231284 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231497 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231595 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.231965 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232074 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232280 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232375 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232590 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232700 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.232904 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233022 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233216 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233317 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233490 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233584 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233792 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.233885 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234105 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234204 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234406 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234499 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234705 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234797 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.234949 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235050 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235253 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235346 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235569 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235672 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.235910 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236014 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236209 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236305 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236455 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236547 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236701 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.236796 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237016 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237125 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237327 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237421 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237630 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237723 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.237933 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238020 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238189 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238286 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238436 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238529 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238753 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.238840 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239071 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239166 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239375 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239460 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.239791 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240004 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240096 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240310 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240400 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240614 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240711 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.240915 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241001 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241220 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241384 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241542 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241687 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241839 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.241984 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242122 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242262 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242428 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242574 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242725 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.242865 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243007 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243149 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243318 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243486 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243652 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243793 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.243933 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244075 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244217 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244366 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244504 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244639 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.244818 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.245655 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.245854 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246018 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246175 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246323 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246472 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246753 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.246898 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247038 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247175 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247267 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247358 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247445 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247671 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247776 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.247978 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248067 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248233 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248330 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248536 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248624 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248843 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.248931 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249161 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249261 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249462 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249548 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249765 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.249858 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250066 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250165 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250366 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250453 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250661 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250790 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.250960 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251131 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251263 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251395 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251569 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251682 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.251899 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252004 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252195 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252282 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252496 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252584 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252796 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.252887 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253094 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253180 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253398 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253485 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253788 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.253999 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254085 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254301 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254390 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254595 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254682 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254896 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.254983 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255193 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255286 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255496 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255583 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255820 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.255909 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256119 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256215 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256421 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256522 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256719 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.256806 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257015 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257120 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257315 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257406 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257611 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257699 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.257907 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258006 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258204 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258292 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258499 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258660 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258793 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.258882 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259089 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259183 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259380 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259467 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259698 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.259802 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260000 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260095 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260301 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260396 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260628 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260767 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260902 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.260985 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.261203 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.261292 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.261500 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.261597 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.261816 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.261903 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.262133 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.262221 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.262438 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.262538 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.262742 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.262837 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.263043 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.263138 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.263357 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:41:34.263448 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.263682 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.263782 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.263994 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264082 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264315 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264404 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264622 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264710 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.264926 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265013 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265231 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265326 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265549 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265647 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265865 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.265973 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266176 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266275 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266489 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266576 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266795 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.266890 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267107 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267194 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267408 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267499 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267745 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.267855 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268068 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268156 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268381 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268467 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268687 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268794 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.268999 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269087 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269316 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269403 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269625 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269723 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.269940 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270028 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270247 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270343 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270564 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270660 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.270869 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271001 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271173 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271260 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271481 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271715 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271805 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.271895 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272113 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272213 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272422 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272519 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272754 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.272849 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273063 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273159 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273372 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273466 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273674 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273763 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.273976 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274064 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274275 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274365 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274581 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274670 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274881 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.274968 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275196 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275309 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275505 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275670 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275834 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.275976 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.276158 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.276333 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.276517 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.276637 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.276937 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277038 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277241 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277328 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277541 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277637 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277850 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.277947 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278157 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278252 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278459 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278549 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278772 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.278869 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279073 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279161 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279376 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279472 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279699 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.279806 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280010 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280097 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280311 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280406 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280611 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280709 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.280912 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281000 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281221 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281308 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281522 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281610 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281836 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.281933 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282137 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282231 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282440 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282535 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282750 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.282837 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283062 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283151 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283366 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283454 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283702 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.283790 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284029 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284119 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284345 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284441 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284640 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284727 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.284947 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285042 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285246 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285333 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285553 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285641 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285854 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.285972 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286159 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286248 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286459 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286553 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286759 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.286856 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287056 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287144 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287356 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287443 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287679 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287782 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.287988 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288075 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288290 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288377 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288591 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288685 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288888 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.288975 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.289441 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.289529 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.289744 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.289841 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290047 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290135 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290368 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290457 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290674 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290762 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.290974 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.291069 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.291277 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.291375 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.291579 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.291718 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.292532 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.292625 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.292886 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293019 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293226 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293338 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293540 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293667 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293865 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.293954 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294184 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294281 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294499 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294593 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294805 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.294902 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295114 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295203 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295425 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295513 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295773 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.295881 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296077 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296165 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296390 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296478 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296693 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.296797 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297000 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297089 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297309 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297398 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297612 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297750 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.297915 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298004 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298221 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298309 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298532 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298633 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298838 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.298932 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299142 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299230 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299445 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299541 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299772 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.299868 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300075 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300161 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300376 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300472 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300677 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300773 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.300984 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301071 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301295 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301386 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301599 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301686 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301912 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.301999 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302219 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302307 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302519 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302615 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302815 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.302902 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303126 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303253 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303428 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303515 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303754 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.303858 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304056 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304152 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304357 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304445 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304666 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304769 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.304970 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305059 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305268 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305365 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305587 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305683 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305889 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.305981 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306191 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306277 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306489 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306585 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306794 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.306888 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.307100 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.307195 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.307461 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308127 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308335 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308423 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308648 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308744 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.308961 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309050 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309272 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309360 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309582 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309677 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309891 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.309980 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310213 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310302 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310520 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310829 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.310918 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311139 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311225 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311437 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311542 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311772 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.311871 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312082 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312169 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312402 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312654 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312752 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.312987 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313075 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313299 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313387 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313602 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313690 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313911 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.313997 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.314224 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.314310 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.314553 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.314787 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.314876 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315120 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315209 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315436 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315652 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315780 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.315952 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316099 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316257 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316418 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316558 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316748 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.316868 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317078 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317165 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317389 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317485 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317695 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.317789 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318003 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318091 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318349 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318458 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318618 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318748 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.318928 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319055 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319234 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319359 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319540 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319696 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319872 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.319999 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320181 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320309 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320483 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320611 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320786 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.320929 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321089 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321235 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321393 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321530 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321704 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.321806 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322008 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322097 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322318 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322432 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322619 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322715 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.322940 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.323067 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.323393 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.323481 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.323803 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.323905 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324114 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324202 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324422 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324509 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324768 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.324856 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325071 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325158 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325374 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325469 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325686 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325783 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.325992 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326087 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326292 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326380 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326601 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326691 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.326919 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327008 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327223 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327310 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327518 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327636 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327848 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.327937 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328149 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328249 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328454 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328545 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328750 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.328918 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329049 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329145 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329347 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329443 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329651 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329746 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.329954 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330040 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330248 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330336 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330558 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330654 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330861 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.330948 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331160 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331248 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331460 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331586 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331786 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.331875 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332086 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332191 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332384 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332472 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.332793 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333006 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333106 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333301 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333388 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333605 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333692 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.333904 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.334881 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.334881 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335019 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335019 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335143 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335217 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335293 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335361 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335426 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335491 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335556 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335649 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335741 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.335946 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336071 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336244 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336326 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336653 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336748 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336889 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.336982 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337171 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337270 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337470 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337633 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337764 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.337956 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.338069 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.338282 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.338387 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.338584 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.338702 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339006 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339093 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339311 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339409 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339664 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339758 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.339943 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340033 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340287 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340387 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340593 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340681 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340913 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.340999 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341217 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341306 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341529 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341617 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341839 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.341949 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342146 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342241 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342442 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342528 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342741 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.342829 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.343048 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.343143 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.343364 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.343483 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.343713 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344045 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344152 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344330 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344426 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344634 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344730 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.344958 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345059 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345256 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345342 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345567 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345661 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345871 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.345966 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346178 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346274 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346486 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346575 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346792 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.346879 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347099 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347199 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347406 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347495 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347737 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.347846 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348046 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348141 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348352 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348446 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348660 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348756 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.348967 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349055 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349270 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349371 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349572 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349660 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349880 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.349967 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350188 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350283 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350488 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350576 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350794 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.350884 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351096 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351191 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351401 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351495 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351732 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.351869 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352044 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352171 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352357 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352486 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352663 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352798 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.352976 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.353101 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.353282 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.353410 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.353719 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.353810 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.354033 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.354121 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.354864 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.354963 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.355172 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.355444 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.355730 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.355890 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356046 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356205 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356378 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356521 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356665 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356855 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.356992 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.357260 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.357456 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.357635 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.357803 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.357941 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358077 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358228 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358353 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358566 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358669 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358875 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.358976 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359188 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359284 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359504 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359592 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359866 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.359953 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360173 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360282 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360480 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360583 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360786 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.360875 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361112 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361280 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361419 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361591 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361743 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.361901 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362162 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362263 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362476 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362564 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362784 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.362881 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363124 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363220 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363437 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363537 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363772 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.363900 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364093 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364193 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364415 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364506 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364726 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.364822 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365041 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365138 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365343 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365431 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365651 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365737 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.365976 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366092 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366284 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366373 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366600 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366687 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.366920 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367017 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367300 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367402 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367550 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367659 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367896 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.367986 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368212 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368301 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368531 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368619 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368834 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.368952 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369144 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369276 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369446 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369588 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369749 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.369952 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.370796 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.370902 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371132 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371269 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371444 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371559 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371784 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.371915 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372094 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372219 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372404 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372528 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372711 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.372827 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373022 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373144 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373323 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373436 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373634 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373747 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.373977 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374113 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374245 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374367 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374551 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374672 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374852 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.374980 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375166 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375285 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375471 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375585 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375805 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.375929 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376109 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376231 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376435 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376561 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376740 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.376857 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377064 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377179 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377409 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377535 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377675 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.377791 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378043 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378164 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378356 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378633 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378766 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.378997 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.379214 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.379330 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.379553 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.379716 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.379943 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380079 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380243 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380378 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380544 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380683 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380845 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.380972 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381139 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381268 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381444 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381582 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381746 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.381875 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382052 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382202 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382340 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382496 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382634 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382805 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.382936 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383113 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383242 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383427 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383557 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383761 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.383894 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384104 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384241 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384368 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384501 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384671 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384803 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.384977 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385107 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385284 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385424 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385645 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385783 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.385988 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386120 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386297 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386437 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386624 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386754 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.386937 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387067 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387246 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387384 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387593 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387748 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.387874 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388012 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388204 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388343 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388511 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388723 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388852 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.388990 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389313 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389449 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389578 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389703 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389828 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.389954 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390087 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390214 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390339 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390464 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390599 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390726 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.390897 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391029 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391297 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391459 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391821 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.391969 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392133 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392264 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392443 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392573 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392751 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.392890 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393068 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393198 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393378 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393514 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393715 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393851 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.393984 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.394285 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.394430 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.394589 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.394727 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.394914 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395052 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395225 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395353 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395538 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395701 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.395886 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396017 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396200 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396330 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396531 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396659 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396805 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.396936 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397114 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397249 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397427 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397571 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397766 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.397902 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398063 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398200 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398377 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398508 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398697 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.398828 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399014 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399168 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399441 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399720 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399720 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.399983 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400110 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400245 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400372 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400504 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400633 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400759 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.400893 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401020 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401197 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401404 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401597 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401730 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.401937 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402073 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402207 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402334 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402459 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402584 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402723 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402850 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.402974 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.403131 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.403261 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.403448 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.403783 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.403917 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404096 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404226 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404409 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404561 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404723 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.404854 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405040 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405175 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405351 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405490 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405664 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405799 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.405978 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406108 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406277 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406415 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406577 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406825 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.406965 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407090 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407229 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407426 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407563 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407809 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.407960 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408088 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408220 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408375 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408505 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408690 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408826 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.408994 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409136 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409306 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409575 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409707 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409840 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.409966 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410154 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410285 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410476 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410607 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410795 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.410937 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411105 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411233 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411404 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411531 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411747 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.411890 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412052 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412189 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412356 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412583 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412714 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.412927 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413058 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413243 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413372 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413539 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413667 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413846 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.413976 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.414394 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.414524 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.414697 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.414835 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415002 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415138 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415302 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415432 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415619 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415769 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.415936 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.416066 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.416233 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.416361 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.416536 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.416677 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.417431 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.417622 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.417800 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418028 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418158 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418297 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418432 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418743 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.418868 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419001 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419136 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419264 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419446 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419730 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.419863 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420002 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420131 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420256 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420388 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420515 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420648 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420783 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.420932 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421063 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421246 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421374 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421543 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421680 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421843 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.421973 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422148 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422276 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422448 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422585 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422750 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.422879 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423054 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423184 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423359 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423508 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423684 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423825 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.423995 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.424133 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.424301 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.424548 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.424679 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.424879 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425016 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425196 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425336 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425509 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425638 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425818 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.425947 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426138 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426343 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426479 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426604 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426729 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.426854 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427024 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427163 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427332 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427477 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427687 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.427930 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428157 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428294 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428420 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428546 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428670 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428830 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.428970 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.429220 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.429349 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.429536 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.429679 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.429939 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430075 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430201 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430326 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430451 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430576 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430736 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.430879 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431050 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431181 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431360 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431491 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431692 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.431833 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.432005 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.432135 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.432317 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.432498 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.433333 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.433646 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.433776 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.433962 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434102 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434276 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434414 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434588 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434718 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.434891 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435020 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435236 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435376 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435558 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435745 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.435883 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436041 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436203 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436334 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436517 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436654 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436830 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.436960 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437140 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437271 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437450 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437579 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437787 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.437924 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438078 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438283 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438414 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438539 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438663 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438796 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.438924 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.439097 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.439265 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.439415 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.439622 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.439769 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440066 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440225 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440361 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440488 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440613 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440751 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.440879 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441028 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441159 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441360 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441490 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441685 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441816 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.441993 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442133 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442300 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442443 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442608 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442773 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.442920 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443052 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443228 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443365 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443549 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443699 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.443880 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444010 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444189 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444330 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444486 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444797 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.444927 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445103 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445244 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445415 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445546 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445745 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.445875 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446055 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446197 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446372 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446507 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446678 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446808 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.446998 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.447115 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.447302 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.447434 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.447676 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.447797 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.448031 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.448205 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.448416 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.449239 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.449239 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.449405 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.449667 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450131 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450235 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450319 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450400 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450629 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450742 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.450989 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451107 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451259 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451366 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451569 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451682 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.451914 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452002 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452239 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452343 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452557 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452655 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452867 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.452956 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453198 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453299 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453499 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453588 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453808 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.453896 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454120 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454209 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454433 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454522 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454743 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.454830 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455051 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455139 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455373 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455467 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455709 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.455814 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456013 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456103 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456324 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456411 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456635 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456759 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.456950 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457038 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457261 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457348 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457576 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457673 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457894 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.457996 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458205 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458304 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458516 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458635 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458829 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.458931 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459139 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459229 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459461 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459560 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459803 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.459894 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.460059 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 17:41:34.460147 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.460439 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.460766 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.461092 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.461440 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.461753 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.462098 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.462425 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:41:34.462667 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=86152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 17:41:34.495142 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_db.sqlalchemy.engines [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.496155 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_db.sqlalchemy.engines [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.740967 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.context [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2e45bcc-5d98-488c-8756-26bea03cb67a(cell1) {{(pid=86152) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 17:41:34.742420 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.context [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2e45bcc-5d98-488c-8756-26bea03cb67a(cell1) {{(pid=86153) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 17:41:34.745587 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_concurrency.lockutils [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:41:34.746834 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:41:34.747301 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_concurrency.lockutils [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:41:34.748153 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_concurrency.lockutils [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:41:34.748501 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:41:34.749301 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:41:34.750116 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_concurrency.lockutils [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86152) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:41:34.751259 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:41:34.776849 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_db.sqlalchemy.engines [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.784439 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_db.sqlalchemy.engines [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.785611 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_db.sqlalchemy.engines [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.785780 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_db.sqlalchemy.engines [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.812792 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG oslo_db.sqlalchemy.engines [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.817381 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_db.sqlalchemy.engines [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:41:34.978467 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO keyring.backend [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Loading KWallet Nov 24 17:41:34.982555 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO keyring.backend [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Loading KWallet Nov 24 17:41:34.988468 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO keyring.backend [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Loading SecretService Nov 24 17:41:34.991709 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:41:34.991709 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: from cryptography.utils import int_from_bytes Nov 24 17:41:34.992033 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:41:34.992033 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: from cryptography.utils import int_from_bytes Nov 24 17:41:34.992197 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO keyring.backend [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Loading SecretService Nov 24 17:41:34.992740 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO keyring.backend [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Loading Windows Nov 24 17:41:34.994542 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO keyring.backend [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Loading chainer Nov 24 17:41:34.995409 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO keyring.backend [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Loading macOS Nov 24 17:41:34.996141 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:41:34.996141 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: from cryptography.utils import int_from_bytes Nov 24 17:41:34.996412 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:41:34.996412 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: from cryptography.utils import int_from_bytes Nov 24 17:41:34.997140 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO keyring.backend [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Loading Windows Nov 24 17:41:34.998983 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO keyring.backend [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Loading chainer Nov 24 17:41:34.999805 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO keyring.backend [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Loading macOS Nov 24 17:41:35.346137 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: WARNING keystonemiddleware.auth_token [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:41:35.352745 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: WARNING keystonemiddleware.auth_token [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:41:35.364859 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: WARNING keystonemiddleware.auth_token [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:41:35.372666 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: WARNING keystonemiddleware.auth_token [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:41:35.566742 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: WARNING keystonemiddleware.auth_token [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:41:35.571855 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: WARNING keystonemiddleware.auth_token [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:41:35.577726 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5573ae2459c0 pid: 86152 (default app) Nov 24 17:41:35.579814 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:41:35.580942 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001696 Nov 24 17:41:35.581349 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Nov 24 17:41:35 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:41:35.589773 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: WARNING keystonemiddleware.auth_token [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:41:35.594935 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: WARNING keystonemiddleware.auth_token [None req-e97512e0-f1b7-48f2-9b9d-c6741b3b5572 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:41:35.600263 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5573ae2459c0 pid: 86153 (default app) Nov 24 17:42:58.193145 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:42:58.194127 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 24 17:42:58.194533 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:42:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:42:58.753178 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-6ee3ef9d-c316-410d-ba4d-6581c1dec9a6 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:42:58.779757 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-6ee3ef9d-c316-410d-ba4d-6581c1dec9a6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.577882 Nov 24 17:42:58.780296 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Nov 24 17:42:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:00.924323 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:00.925312 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-309c96b6-6cbf-4af4-85a9-abea2c91f0ed None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 24 17:43:00.925708 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:00.983892 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-350baec2-ac1f-4dc6-b099-a7c14e491b16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "swap": 0}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:01.002452 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:43:01.002452 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:43:01.029086 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-350baec2-ac1f-4dc6-b099-a7c14e491b16 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.096491 Nov 24 17:43:01.029668 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:01.259811 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-574e65b7-cb53-4d57-9a13-1ea0d684935a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:01.262082 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:43:01.262082 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: warnings.warn(msg) Nov 24 17:43:01.428039 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-574e65b7-cb53-4d57-9a13-1ea0d684935a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.390435 Nov 24 17:43:01.428623 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Nov 24 17:43:01 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:03.609275 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-350baec2-ac1f-4dc6-b099-a7c14e491b16 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:03.610272 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-350baec2-ac1f-4dc6-b099-a7c14e491b16 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 24 17:43:03.610678 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:03.717221 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-ef98c8ab-2fdf-4df6-b94e-b15e0253eb86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "d1", "name": "ds512M"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:03.735106 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:43:03.735106 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: warnings.warn(msg) Nov 24 17:43:03.758897 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-ef98c8ab-2fdf-4df6-b94e-b15e0253eb86 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142340 Nov 24 17:43:03.759451 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:03.771494 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-fa4d5b17-90e2-4ee5-969a-8ca8b582abb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:03.772975 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:43:03.772975 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:43:03.810078 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-fa4d5b17-90e2-4ee5-969a-8ca8b582abb5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042645 Nov 24 17:43:03.810663 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Nov 24 17:43:03 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:43:05.965623 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-ef98c8ab-2fdf-4df6-b94e-b15e0253eb86 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:05.966630 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-ef98c8ab-2fdf-4df6-b94e-b15e0253eb86 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Nov 24 17:43:05.967031 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:06.025652 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-6e2d511d-414f-4409-91f1-62a4fca3e6a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:06.049179 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-6e2d511d-414f-4409-91f1-62a4fca3e6a0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075608 Nov 24 17:43:06.049737 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:06.062381 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-06a5c560-9ba6-4a29-8aeb-b30f0cbae4b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:06.097169 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-06a5c560-9ba6-4a29-8aeb-b30f0cbae4b8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038356 Nov 24 17:43:06.097728 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Nov 24 17:43:06 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:08.310765 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-6e2d511d-414f-4409-91f1-62a4fca3e6a0 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:08.311799 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-6e2d511d-414f-4409-91f1-62a4fca3e6a0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 24 17:43:08.312225 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:08.370276 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-aa8ef0bd-1bcb-4cc7-95f8-5fb7a638e18c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:08.394203 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-aa8ef0bd-1bcb-4cc7-95f8-5fb7a638e18c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076124 Nov 24 17:43:08.394753 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:43:08.407804 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-b9e3065d-a175-49f1-ae92-4a5411880df4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:08.445020 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-b9e3065d-a175-49f1-ae92-4a5411880df4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040887 Nov 24 17:43:08.446040 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Nov 24 17:43:08 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:43:10.612812 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-aa8ef0bd-1bcb-4cc7-95f8-5fb7a638e18c admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:10.613808 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-aa8ef0bd-1bcb-4cc7-95f8-5fb7a638e18c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 24 17:43:10.614213 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:10.671699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "swap": 0}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:10.696259 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075342 Nov 24 17:43:10.696863 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:10.708237 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e6aa630f-be41-40d6-a521-ecf2a381639d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:10.744125 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e6aa630f-be41-40d6-a521-ecf2a381639d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039378 Nov 24 17:43:10.744702 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Nov 24 17:43:10 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:12.894807 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:12.895861 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Nov 24 17:43:12.896268 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:12.953030 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-218411b6-dc9a-4e97-9116-4c7cf4d9fc72 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:12.975378 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-218411b6-dc9a-4e97-9116-4c7cf4d9fc72 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.072987 Nov 24 17:43:12.975937 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Nov 24 17:43:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:43:15.141083 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:15.142126 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-29203bed-f367-4936-a1e9-2e63dee81560 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 24 17:43:15.142567 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:15.200890 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-ab9f338f-ac33-4fb7-a827-446ca5543f1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:15.223864 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-ab9f338f-ac33-4fb7-a827-446ca5543f1a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075194 Nov 24 17:43:15.224401 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:15 2021] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:43:15.236981 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-7fecd0b4-2fb4-4454-a4ad-09b41c67d8b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:15.272260 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-7fecd0b4-2fb4-4454-a4ad-09b41c67d8b2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038938 Nov 24 17:43:15.272830 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Nov 24 17:43:15 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:17.431794 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-ab9f338f-ac33-4fb7-a827-446ca5543f1a admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:17.432849 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-ab9f338f-ac33-4fb7-a827-446ca5543f1a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Nov 24 17:43:17.433252 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:17.491525 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-4ca8d124-c308-4a93-b655-f54d3294d91c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:17.515845 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-4ca8d124-c308-4a93-b655-f54d3294d91c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076488 Nov 24 17:43:17.516379 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:17 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:43:17.528159 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-b13dde5f-5bd7-473c-b6df-0b8d0990a882 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:17.563542 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-b13dde5f-5bd7-473c-b6df-0b8d0990a882 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038987 Nov 24 17:43:17.564129 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Nov 24 17:43:17 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:19.742466 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-4ca8d124-c308-4a93-b655-f54d3294d91c admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:19.743467 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-4ca8d124-c308-4a93-b655-f54d3294d91c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Nov 24 17:43:19.743974 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:19.799295 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e5f6206f-27aa-4029-89d5-a44d96962a5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:19.826219 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e5f6206f-27aa-4029-89d5-a44d96962a5f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076224 Nov 24 17:43:19.826770 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:19 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:19.839018 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e850fa82-e621-4919-b885-6a4f90f9d7ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:19.878640 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e850fa82-e621-4919-b885-6a4f90f9d7ad admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043876 Nov 24 17:43:19.879207 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Nov 24 17:43:19 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:22.056795 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e5f6206f-27aa-4029-89d5-a44d96962a5f admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:22.057831 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e5f6206f-27aa-4029-89d5-a44d96962a5f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 24 17:43:22.058230 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:43:22.115749 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-7ab9d7a6-a7ed-4ac8-b1f1-c30f0d96f513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "id": "4"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:22.139651 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-7ab9d7a6-a7ed-4ac8-b1f1-c30f0d96f513 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075255 Nov 24 17:43:22.140218 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:43:22.152053 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-77b291eb-bb45-4751-8e49-c05fc53b8bbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:22.187620 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-77b291eb-bb45-4751-8e49-c05fc53b8bbb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039376 Nov 24 17:43:22.188266 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Nov 24 17:43:22 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:43:24.331479 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-7ab9d7a6-a7ed-4ac8-b1f1-c30f0d96f513 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:43:24.332497 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-7ab9d7a6-a7ed-4ac8-b1f1-c30f0d96f513 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 24 17:43:24.332896 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:43:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:43:24.390212 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:24.415192 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076107 Nov 24 17:43:24.415888 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Nov 24 17:43:24 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:43:24.432293 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-30c28c00-3cce-4eba-97be-49c96ff0643e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:43:24.467733 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-30c28c00-3cce-4eba-97be-49c96ff0643e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040007 Nov 24 17:43:24.468308 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Nov 24 17:43:24 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:44:31.407111 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:31.408388 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001742 Nov 24 17:44:31.408872 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed Nov 24 17:44:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:31.465947 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-644197bb-b4e8-47e2-961f-8c9697229060 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:31.489591 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-644197bb-b4e8-47e2-961f-8c9697229060 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073584 Nov 24 17:44:31.490129 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Nov 24 17:44:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:32.888026 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:32.889023 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-cc43d49e-d4bd-420f-ad2c-e81a9d4066e8 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 24 17:44:32.889420 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:33.077489 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-7e143562-8794-45f0-afa5-967a0dadd44a admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:33.089552 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.wsgi [None req-7e143562-8794-45f0-afa5-967a0dadd44a admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 17:44:33.090118 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-7e143562-8794-45f0-afa5-967a0dadd44a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:33.090899 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-7e143562-8794-45f0-afa5-967a0dadd44a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063944 Nov 24 17:44:33.091407 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 24 17:44:33 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:33.101089 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-24f33093-012b-4532-b73d-b69c816de9a7 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:33.122105 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-24f33093-012b-4532-b73d-b69c816de9a7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024818 Nov 24 17:44:33.122661 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:33.132403 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-06a5d38e-00cb-4152-aee5-78560ad53328 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:33.152974 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-06a5d38e-00cb-4152-aee5-78560ad53328 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024097 Nov 24 17:44:33.153518 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:33.162912 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-8d4afb0e-f320-43ac-b2e9-cdb78cb59842 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:33.175887 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.wsgi [None req-8d4afb0e-f320-43ac-b2e9-cdb78cb59842 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 17:44:33.176455 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-8d4afb0e-f320-43ac-b2e9-cdb78cb59842 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=86152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:33.177233 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-8d4afb0e-f320-43ac-b2e9-cdb78cb59842 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017938 Nov 24 17:44:33.177733 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 24 17:44:33 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:34.539829 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-06a5d38e-00cb-4152-aee5-78560ad53328 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:34.541083 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-06a5d38e-00cb-4152-aee5-78560ad53328 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Nov 24 17:44:34.541476 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:34.732455 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-34a5c601-c026-47f0-94fd-c4cbc6cd90be admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:34.744425 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.wsgi [None req-34a5c601-c026-47f0-94fd-c4cbc6cd90be admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 17:44:34.744985 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-34a5c601-c026-47f0-94fd-c4cbc6cd90be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:34.745783 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-34a5c601-c026-47f0-94fd-c4cbc6cd90be admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.062726 Nov 24 17:44:34.746288 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 24 17:44:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:34.755653 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-119e82ba-25a8-4b9e-bc9a-d1f7007326d2 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:34.776102 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-119e82ba-25a8-4b9e-bc9a-d1f7007326d2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023909 Nov 24 17:44:34.776635 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:34.786026 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-212b1d3f-8cee-4ff1-8719-a88f0d79d08e admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:34.806842 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-212b1d3f-8cee-4ff1-8719-a88f0d79d08e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024256 Nov 24 17:44:34.807451 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:34.818803 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-eecfc3b8-bb12-4341-9144-b632d2c9af66 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:34.831106 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.wsgi [None req-eecfc3b8-bb12-4341-9144-b632d2c9af66 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 17:44:34.831718 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-eecfc3b8-bb12-4341-9144-b632d2c9af66 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=86153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:34.832512 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-eecfc3b8-bb12-4341-9144-b632d2c9af66 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017421 Nov 24 17:44:34.833034 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 24 17:44:34 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:36.186542 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-212b1d3f-8cee-4ff1-8719-a88f0d79d08e admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:36.187539 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-212b1d3f-8cee-4ff1-8719-a88f0d79d08e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 24 17:44:36.188169 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:36.374724 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-87945366-2afd-4952-b440-e53347e4007c admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:36.387328 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.wsgi [None req-87945366-2afd-4952-b440-e53347e4007c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 17:44:36.387918 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-87945366-2afd-4952-b440-e53347e4007c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:36.388699 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-87945366-2afd-4952-b440-e53347e4007c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.065845 Nov 24 17:44:36.389214 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:44:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:36.399475 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-d6fc777b-f76a-48b8-81aa-d91c2b211718 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:36.419856 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-d6fc777b-f76a-48b8-81aa-d91c2b211718 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024621 Nov 24 17:44:36.420434 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:36.430083 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:36.450419 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023847 Nov 24 17:44:36.451004 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 24 17:44:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:44:36.465749 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-2cc77003-5086-4b14-b95c-88ead0d463a8 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:36.479520 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.wsgi [None req-2cc77003-5086-4b14-b95c-88ead0d463a8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 17:44:36.480206 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-2cc77003-5086-4b14-b95c-88ead0d463a8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=86152) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:44:36.481001 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-2cc77003-5086-4b14-b95c-88ead0d463a8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.024116 Nov 24 17:44:36.481530 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:44:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 17:44:37.813981 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:37.814978 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 24 17:44:37.815391 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:38.002616 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-cdc39787-0b2d-4ee5-8db0-e82f3a8aae2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:44:38.031123 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-cdc39787-0b2d-4ee5-8db0-e82f3a8aae2c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.077896 Nov 24 17:44:38.031585 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 24 17:44:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:44:39.383524 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:39.384823 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002347 Nov 24 17:44:39.385432 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:39.574282 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-7a7fdaad-8ccb-4b48-be69-3123e111e250 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:44:39.597952 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-7a7fdaad-8ccb-4b48-be69-3123e111e250 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.075253 Nov 24 17:44:39.598420 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 24 17:44:39 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:44:40.935439 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:40.936482 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Nov 24 17:44:40.936872 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:41.128646 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-56137445-ffad-49f7-9ce6-5697f8d19b21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:44:41.156448 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-56137445-ffad-49f7-9ce6-5697f8d19b21 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.079445 Nov 24 17:44:41.156926 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 24 17:44:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:44:42.504168 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:42.505166 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 24 17:44:42.505560 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:42.705943 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-07223a46-3baf-4e85-9080-ea087eb22ac2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:44:42.730790 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-07223a46-3baf-4e85-9080-ea087eb22ac2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.089532 Nov 24 17:44:42.731328 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 24 17:44:42 2021] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:44:44.062264 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:44.063267 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Nov 24 17:44:44.063698 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:44:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:44:44.249836 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-6e372abb-2b07-4e69-b11a-308ec04df0df admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:44:44.276373 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-6e372abb-2b07-4e69-b11a-308ec04df0df admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076987 Nov 24 17:44:44.276928 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Nov 24 17:44:44 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 17:45:29.064000 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:45:29.065034 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-e7004631-61d4-4972-ade4-57f36c655cf1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 24 17:45:29.065453 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 31/63] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:45:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:45:29.264467 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:45:29.290927 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.077138 Nov 24 17:45:29.291396 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Nov 24 17:45:29 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:46:51.137176 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-0630e74d-e655-4f11-b5c1-512ac8ffde92 tempest-verify_tempest_config-1654174361 tempest-verify_tempest_config-1654174361-project] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:46:51.139218 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-0630e74d-e655-4f11-b5c1-512ac8ffde92 tempest-verify_tempest_config-1654174361 tempest-verify_tempest_config-1654174361-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112878 Nov 24 17:46:51.139784 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Nov 24 17:46:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:48:24.526280 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:24.527402 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Nov 24 17:48:24.527837 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 34/66] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:48:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:48:24.788315 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:24.790113 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:48:24.790113 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:48:24.791953 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:24.792391 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:24.793180 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:24.793600 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:24.823869 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-29588c8f-4910-445a-bcf9-74b294f45eae admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.155091 Nov 24 17:48:24.824445 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:48:24 2021] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:48:26.185471 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:26.186457 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Nov 24 17:48:26.186842 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 35/68] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:48:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:48:26.372673 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:26.373826 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:48:26.373826 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:48:26.375355 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:26.375825 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:26.376608 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:26.377029 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:26.400945 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-83033acf-50f0-48f5-854a-9fb4bca0b12d admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.078895 Nov 24 17:48:26.401516 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 34/69] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:48:26 2021] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:48:38.225321 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:38.226299 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 24 17:48:38.226693 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:48:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:48:38.420426 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:38.421716 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:48:38.421716 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:48:38.423207 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:38.423662 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:38.424478 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:38.424897 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:38.455584 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-152791f0-8395-49d2-8db7-cc2e697b695c admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.088435 Nov 24 17:48:38.456177 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 35/71] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:48:38 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:48:39.816058 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: DEBUG nova.api.openstack.wsgi [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] Calling method '>' {{(pid=86152) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:39.817053 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: INFO nova.api.openstack.requestlog [None req-e809fd32-35a5-4a0c-9a18-2fdf1f6a2345 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 24 17:48:39.817458 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: [pid: 86152|app: 0|req: 37/72] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 24 17:48:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:48:40.027582 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG nova.api.openstack.wsgi [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] Calling method '>' {{(pid=86153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:48:40.028818 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:48:40.028818 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: warnings.warn(msg) Nov 24 17:48:40.030386 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:40.030829 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:40.031695 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:48:40.032050 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: DEBUG oslo_concurrency.lockutils [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=86153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:48:40.057918 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: INFO nova.api.openstack.requestlog [None req-534de63f-b793-4899-afda-e1f610c91b2e admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.082210 Nov 24 17:48:40.058470 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: [pid: 86153|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 24 17:48:39 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 17:49:37.467187 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: Wed Nov 24 17:49:37 2021 - graceful shutdown triggered... Nov 24 17:49:37.464774 dv-cinder-818579-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 24 17:49:37.468347 dv-cinder-818579-1-iscsi devstack@n-api.service[86152]: Gracefully killing worker 1 (pid: 86152)... Nov 24 17:49:37.468825 dv-cinder-818579-1-iscsi devstack@n-api.service[86153]: Gracefully killing worker 2 (pid: 86153)... Nov 24 17:49:38.464937 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: worker 1 buried after 1 seconds Nov 24 17:49:38.464937 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: worker 2 buried after 1 seconds Nov 24 17:49:38.465215 dv-cinder-818579-1-iscsi devstack@n-api.service[86151]: goodbye to uWSGI. Nov 24 17:49:38.466488 dv-cinder-818579-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 24 17:49:38.467052 dv-cinder-818579-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 24 17:49:38.469862 dv-cinder-818579-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 17:49:38.480090 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 17:49:38 2021] *** Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: nodename: dv-cinder-818579-1-iscsi Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: machine: x86_64 Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: clock source: unix Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: pcre jit disabled Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: detected number of CPU cores: 4 Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: current working directory: / Nov 24 17:49:38.481863 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: detected binary path: /usr/bin/uwsgi-core Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: your processes number limit is 47680 Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: your memory page size is 4096 bytes Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: detected max file descriptor number: 2048 Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: lock engine: pthread robust mutexes Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: thunder lock: enabled Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 17:49:38.482646 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 17:49:38.524576 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: Python main interpreter initialized at 0x55cbe542f9c0 Nov 24 17:49:38.524576 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: python threads support enabled Nov 24 17:49:38.524576 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: your server socket listen backlog is limited to 100 connections Nov 24 17:49:38.524576 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: your mercy for graceful operations on workers is 90 seconds Nov 24 17:49:38.525030 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 17:49:38.525030 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: *** Operational MODE: preforking *** Nov 24 17:49:38.525375 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: *** uWSGI is running in multiple interpreter mode *** Nov 24 17:49:38.525375 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: spawned uWSGI master process (pid: 100936) Nov 24 17:49:38.526034 dv-cinder-818579-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 17:49:38.526220 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: spawned uWSGI worker 1 (pid: 100948, cores: 1) Nov 24 17:49:38.526513 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: spawned uWSGI worker 2 (pid: 100949, cores: 1) Nov 24 17:49:38.526684 dv-cinder-818579-1-iscsi devstack@n-api.service[100936]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 17:49:42.560633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 17:49:42.561375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 17:49:42.561375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 17:49:42.561702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 17:49:42.561967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 17:49:42.562349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.562675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.562993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.563322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.563705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.563977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.564299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.564622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.564951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.565209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.565524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.565852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818579-1-iscsi {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.566174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.566481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.566789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.567104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.567409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.567753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.568063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.568560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.569981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.569981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.569981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.569981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.570291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.570532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.570845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.571166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.571470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.571863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.572194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818579-1-iscsi {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.572555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.572872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.573187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.573608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.573926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.574223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.574543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.574864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.575188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.575499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.575873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.576174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.576484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.576790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.577101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.577400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.577724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.578027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.578334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.578585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.578893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.579216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.579539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.579888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.580141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.580390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.580709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.581030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.581343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.581650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.581957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.582267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.582573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.582879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.583185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.583492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.583837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.584159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.584477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.584784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.585104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.585499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.585749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.586058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.586397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.586716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.587023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.587207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 17:49:42.587852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.588009 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 17:49:42.588169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.588323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 17:49:42.588323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 17:49:42.588610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.588755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 17:49:42.588898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.588898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.589258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.589415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.589560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.589711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.589866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590631 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.590937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591742 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.591901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.592046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.592206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.592645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.592797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.592957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818579-1-iscsi {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.593851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.594001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.594162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.594383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.594532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.594685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.595549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.595752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.595900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.596073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.596308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.596591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.596791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.597900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.598965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599761 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.599918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818579-1-iscsi {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.600902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.601935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.602091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.602244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.602414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.602936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.603659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.603826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.603988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.604971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605731 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.605881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.606033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.606183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.606183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.606874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.607039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.607291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.607533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.607730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.607889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.608047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.608192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.608342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.608494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.608644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.609410 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.609596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.609745 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.609895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.610045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.610045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.610431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.610593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.610747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.610892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.611035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.611035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.611325 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.611486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.611680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.611841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.611985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.612140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.612294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.612294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.612562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.613085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.613238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.613396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.613554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.613715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.613948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.614116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.614403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.614659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.614827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.614972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.615114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.615261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.615404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.615666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.615817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.615976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.616122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.616122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.616397 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.616553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.616787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.616787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.617190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.617190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.617687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.617839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.617982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.618125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.618267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.618267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.618545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.618545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.619477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.619477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.619912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.620138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.620384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.620637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.620996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.620996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.621478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.621709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.621882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.622031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.622174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.622174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.622465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.622618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.622780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.623284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.623439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.623582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.623799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.623964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.624116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.624259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.624411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.624560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.624788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.624958 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.625103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.625258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.625496 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.625741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.625987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.625987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.626453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.626692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.626976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.627139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.627428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.627686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.627851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.627851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.628134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.628134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.628428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.628580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.628580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.628858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.629008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.629150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.629302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.629302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.629579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.629742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.629742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.630026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.630179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.630179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.630459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.630608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.630760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.630986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.631132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.631274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.631416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.631566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.631566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.631920 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.632066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.632066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.632348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.632501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.632645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.632796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.632796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.633447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.633447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.633784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.633948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.634093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.634242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.634444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.634599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.634777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.634777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.635137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.635137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.635407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.635548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.635726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.635726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.636036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.636180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.636329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.636329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.636613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.636613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.636883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.637133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.637283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.637458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.637615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.637865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.638025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.638182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.638332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.638489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.638639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.638789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.638939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.639092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.639235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.639391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.639534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.639719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.639864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.640007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.640160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.640315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.640467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.640611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.640762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 17:49:42.640907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.641976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642430 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.642871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.643016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.643176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.643663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.643828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.643974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.644892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.645870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646020 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.646897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.647050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.647285 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.647445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.647623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.647776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.648924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.649998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.650986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.651949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.652244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.652412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.652563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.652714 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.652866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.653023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.653172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.653314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.653800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.653966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.654951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.655965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.656849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657319 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.657834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.658010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.658239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.658395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.658673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.658844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.659934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.660998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661588 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661742 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.661893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.662915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.663058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.663216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.663359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.663541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.664921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.665074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.665224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.665459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.666395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.666549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.666701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.666852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667446 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.667978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.668884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.669948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.670994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.671914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.672912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.673810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.674286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.674432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.674584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.674743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.674895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.675904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676820 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.676970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.677846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.678903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.679841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.680889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.681033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.681277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.682982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.683999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.684705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.684851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.685986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686446 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.686886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.687965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688108 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688693 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.688850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689181 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.689901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.690955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.691930 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.692852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.693911 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.694054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.694362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.694734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.694888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.695841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.696903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.697918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.698970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699128 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.699780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.700846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.701964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.702893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.703857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.704007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.704164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.704480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.704804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.704804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705412 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.705894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706051 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.706925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.707910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.708854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.709957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.710952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.711972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.712145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.712296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.712504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.712677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.712828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.713906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.714072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.714229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.714654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.714955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.715980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.716140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.716290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.716290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.716679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.716854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.717947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.718875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.719980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.720942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.721884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.722979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.723941 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.724090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.724245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.724403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.724578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.725952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.726964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.727940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.728642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.728884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.729894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.730980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.731947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.732892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.733981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.734138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.734296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.734454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.734613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.734913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.735327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.735327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.735653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.735810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.735972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.736133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.736283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.736444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.736602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.736783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.737939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738386 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738553 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.738942 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.739883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740034 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.740967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.741922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.742866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.743023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.743173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.743321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.743479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.743784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.744437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.744437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.744842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.745258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.745496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.745496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.745796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.745954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.746721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.747795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.748871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.749987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.750145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.750295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.750525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.750697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.750858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.751967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.752889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.753960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.754886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.755035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.755301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.755473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.755656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.755826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.756847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.757875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758037 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.758964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.759114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.759272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.759483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.759803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.759993 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.760207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.760383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.760545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.760704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.760862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.761859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.762956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.763106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.763262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.763518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.763697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.763853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764343 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.764982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.765141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.765318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.765555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.765719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.765869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766020 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.766956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.767123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.767525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.767752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.767918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768071 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.768899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.769855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770328 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.770925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.771893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.772919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.773953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.774254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.774404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.774554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.774711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.774862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.775084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.775247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.775469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.775779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.775950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.776728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.777879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.778939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779558 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.779912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780354 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.780979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.781919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.782990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.783914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.784981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.785139 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.785307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.785464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.785625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.785793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.786954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.787110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.787270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.787421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.787582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.787835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788635 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.788943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.789943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.790107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.790259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.790407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.791330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.791500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.791682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.791840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.791990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.792910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.793072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.793243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.793408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.793661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.793834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.794928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.795890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.796933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797092 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.797971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.798915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799232 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.799890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.800826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.801952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802180 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.802980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.803990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.804238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.804397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.804548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.804700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.804851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805324 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.805936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.806088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.806361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.807926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.808950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.809903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.810989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.811996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.812961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.813926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.814077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.814270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.814270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.814776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.814776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.815956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816115 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.816446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.817694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.818929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.822420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.824149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.825951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.827287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.828733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.830260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.831429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.832272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.832272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.832272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.832736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.833238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.833423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.833768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.834115 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.834452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.834811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.835650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.835650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.835859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.836178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 17:49:42.836433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100948) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 17:49:42.838080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_db.sqlalchemy.engines [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:42.870975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_db.sqlalchemy.engines [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.084687 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.context [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2e45bcc-5d98-488c-8756-26bea03cb67a(cell1) {{(pid=100949) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 17:49:43.089781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:49:43.091438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:49:43.092254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:49:43.094218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:49:43.119668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_db.sqlalchemy.engines [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.121001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.context [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f2e45bcc-5d98-488c-8756-26bea03cb67a(cell1) {{(pid=100948) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 17:49:43.121293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_db.sqlalchemy.engines [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.125334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:49:43.126988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:49:43.127808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:49:43.129792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:49:43.152947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_db.sqlalchemy.engines [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.157874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_db.sqlalchemy.engines [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.157874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_db.sqlalchemy.engines [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.191594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_db.sqlalchemy.engines [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100948) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Nov 24 17:49:43.409001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO keyring.backend [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Loading KWallet Nov 24 17:49:43.418457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO keyring.backend [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Loading SecretService Nov 24 17:49:43.421890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:49:43.421890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: from cryptography.utils import int_from_bytes Nov 24 17:49:43.422209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:49:43.422209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: from cryptography.utils import int_from_bytes Nov 24 17:49:43.423226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO keyring.backend [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Loading Windows Nov 24 17:49:43.425457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO keyring.backend [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Loading chainer Nov 24 17:49:43.426449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO keyring.backend [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Loading macOS Nov 24 17:49:43.435084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO keyring.backend [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Loading KWallet Nov 24 17:49:43.444231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO keyring.backend [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Loading SecretService Nov 24 17:49:43.448454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:49:43.448454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: from cryptography.utils import int_from_bytes Nov 24 17:49:43.448780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 17:49:43.448780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: from cryptography.utils import int_from_bytes Nov 24 17:49:43.449530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO keyring.backend [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Loading Windows Nov 24 17:49:43.451476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO keyring.backend [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Loading chainer Nov 24 17:49:43.452304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO keyring.backend [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Loading macOS Nov 24 17:49:43.686295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: WARNING keystonemiddleware.auth_token [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:49:43.692939 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: WARNING keystonemiddleware.auth_token [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:49:43.716697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: WARNING keystonemiddleware.auth_token [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:49:43.723549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: WARNING keystonemiddleware.auth_token [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:49:43.910907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: WARNING keystonemiddleware.auth_token [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:49:43.916801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: WARNING keystonemiddleware.auth_token [None req-33204196-7010-4111-ba30-0aaf60cf6ae8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:49:43.922161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbe542f9c0 pid: 100949 (default app) Nov 24 17:49:43.946648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: WARNING keystonemiddleware.auth_token [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 17:49:43.952065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: WARNING keystonemiddleware.auth_token [None req-0e19cf3d-a4fe-42fc-8203-ae97f5137277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 17:49:43.957464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbe542f9c0 pid: 100948 (default app) Nov 24 17:50:43.432691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-06c4d403-9e2e-4d58-8487-1334025b2407 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Action: 'create', calling method: .version_select at 0x7f8b115ded30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1995369142", "metadata": {"Type": "work"}}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:50:43.435713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-06c4d403-9e2e-4d58-8487-1334025b2407 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:43.436737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-06c4d403-9e2e-4d58-8487-1334025b2407 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.507262 Nov 24 17:50:43.455694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Nov 24 17:50:41 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1515 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 17:50:43.954984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d8b74e84-d15c-4841-b0c5-6b7c7670260e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Action: 'create', calling method: .version_select at 0x7f8b11629820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2132380185", "metadata": {"Type": "work"}}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:50:43.958623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d8b74e84-d15c-4841-b0c5-6b7c7670260e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:43.959870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d8b74e84-d15c-4841-b0c5-6b7c7670260e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.514851 Nov 24 17:50:43.972171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26c73912-e21b-45c3-a886-d88dbb528740 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Action: 'create', calling method: .version_select at 0x7f8b11545790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-407959718", "metadata": {"Type": "work"}}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:50:43.974055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26c73912-e21b-45c3-a886-d88dbb528740 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:43.975067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26c73912-e21b-45c3-a886-d88dbb528740 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008068 Nov 24 17:50:43.976457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Nov 24 17:50:43 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 17:50:43.983554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Nov 24 17:50:43 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 17:50:43.986974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0ef160f7-1a38-45b7-9658-88bfb0e6d7c0 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Calling method '.version_select at 0x7f8b115ded30>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:44.636743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-0ef160f7-1a38-45b7-9658-88bfb0e6d7c0 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] HTTP exception thrown: Volume tempest-invalid-1598767563 could not be found. Nov 24 17:50:44.638265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0ef160f7-1a38-45b7-9658-88bfb0e6d7c0 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 404 to user: Volume tempest-invalid-1598767563 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:44.639244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0ef160f7-1a38-45b7-9658-88bfb0e6d7c0 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1598767563" status: 404 len: 99 microversion: 2.1 time: 0.656902 Nov 24 17:50:44.640056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Nov 24 17:50:43 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1598767563 => generated 99 bytes in 658 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 24 17:50:44.649407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-63b29366-8138-4765-92dc-95bd3b07971c tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 Nov 24 17:50:44.650070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 2/5] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Nov 24 17:50:44 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 17:50:44.661998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-433bae2e-54bb-44a4-8329-955ea4d537d3 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004399 Nov 24 17:50:44.664047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 4/6] 10.222.0.64 () {58 vars in 1136 bytes} [Wed Nov 24 17:50:44 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 17:50:44.673309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-44ac3558-bfa3-4b01-90d5-83f10b251d7e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Calling method '.version_select at 0x7f8b11ad3940>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:45.554551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-44ac3558-bfa3-4b01-90d5-83f10b251d7e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] HTTP exception thrown: Volume 1f8b3ee9-a67f-4b56-b6b2-89bbe753ad35 could not be found. Nov 24 17:50:45.555950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-44ac3558-bfa3-4b01-90d5-83f10b251d7e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 404 to user: Volume 1f8b3ee9-a67f-4b56-b6b2-89bbe753ad35 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:45.556943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-44ac3558-bfa3-4b01-90d5-83f10b251d7e tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1f8b3ee9-a67f-4b56-b6b2-89bbe753ad35" status: 404 len: 109 microversion: 2.1 time: 0.888505 Nov 24 17:50:45.558207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 3/7] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 17:50:44 2021] DELETE /compute/v2.1/os-volumes/1f8b3ee9-a67f-4b56-b6b2-89bbe753ad35 => generated 109 bytes in 890 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:50:45.568139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7a707e9-2999-4f7c-a84a-600be0be37e7 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Calling method '.version_select at 0x7f8b11545040>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:45.694720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-c7a707e9-2999-4f7c-a84a-600be0be37e7 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] HTTP exception thrown: Volume 63adfef8-ea9f-4e7d-9b20-86253ad0b36d could not be found. Nov 24 17:50:45.695304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7a707e9-2999-4f7c-a84a-600be0be37e7 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] Returning 404 to user: Volume 63adfef8-ea9f-4e7d-9b20-86253ad0b36d could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:50:45.696694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c7a707e9-2999-4f7c-a84a-600be0be37e7 tempest-VolumesNegativeTest-1582622144 tempest-VolumesNegativeTest-1582622144-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/63adfef8-ea9f-4e7d-9b20-86253ad0b36d" status: 404 len: 109 microversion: 2.1 time: 0.131952 Nov 24 17:50:45.711697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:50:45 2021] GET /compute/v2.1/os-volumes/63adfef8-ea9f-4e7d-9b20-86253ad0b36d => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:50:45.866801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-892914360", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "4b77fbf8-e8b3-4ea6-ba54-107fd0cb3ac2"}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:50:46.147266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] validate_networks() for [('4b77fbf8-e8b3-4ea6-ba54-107fd0cb3ac2', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:50:48.717361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1494202406", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "d999ad69-34a5-4430-8f01-a48e3a42bfc5"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:50:48.900474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:50:48.901694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:50:48.902753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:50:48.903403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:50:48.904068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:50:48.938914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] validate_networks() for [('d999ad69-34a5-4430-8f01-a48e3a42bfc5', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:50:48.950959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:48.954988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:48.955897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:48.959189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:49.020157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Getting quotas for project fcf323d9d7dd42c7bfe427677fe26584. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:50:49.031593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Getting quotas for user 713d6500bb8c46b0afad0048d9bac713 and project fcf323d9d7dd42c7bfe427677fe26584. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:50:49.062517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:50:49.068159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:50:49.294273 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-286658bb-aa0c-49e9-bd2e-d903f3247495 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.656693 Nov 24 17:50:49.295514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 4/9] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:50:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 3659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:50:49.308439 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2ef25ee9-7313-4b87-9677-3a9f09b10d3f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:49.309244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2ef25ee9-7313-4b87-9677-3a9f09b10d3f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:49.528396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2ef25ee9-7313-4b87-9677-3a9f09b10d3f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:49.547301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2ef25ee9-7313-4b87-9677-3a9f09b10d3f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1214 microversion: 2.1 time: 0.245458 Nov 24 17:50:49.548106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:49 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1214 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:50:50.565829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-10c4c25d-6924-4604-aa09-dce7dae938b9 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:50.566546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-10c4c25d-6924-4604-aa09-dce7dae938b9 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:50.788499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-10c4c25d-6924-4604-aa09-dce7dae938b9 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:50.801680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-10c4c25d-6924-4604-aa09-dce7dae938b9 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1214 microversion: 2.1 time: 0.240898 Nov 24 17:50:50.804312 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:50 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:50:51.820832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:51.822174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:51.835472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:51.843789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:51.844948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:51.845595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:51.866559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:50:51.867511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:50:51.868311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:50:51.868914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:50:51.869483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:50:51.890826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:51.891552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:51.892527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:51.904353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:51.945525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:50:51.968814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for user 6a81c70350ee4996b85c33ec8fedaa55 and project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:50:52.018549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:50:52.028085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:50:52.213603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-44c3d184-43d4-4225-91d6-de8b7dad1ad9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.772165 Nov 24 17:50:52.215216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 6/12] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:50:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 3775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:50:52.225737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-64725223-9c89-494e-bd58-2c78ce1b0dbb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:52.226395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-64725223-9c89-494e-bd58-2c78ce1b0dbb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:52.266084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:52.285014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1175cb02-f942-4d64-8488-abb2dedf5ddf tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1218 microversion: 2.1 time: 0.467650 Nov 24 17:50:52.290702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:51 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1218 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:50:52.914260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-64725223-9c89-494e-bd58-2c78ce1b0dbb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:52.951192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-64725223-9c89-494e-bd58-2c78ce1b0dbb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1218 microversion: 2.1 time: 0.729490 Nov 24 17:50:52.953686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:52 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1218 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:50:53.302788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:53.303402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:53.323719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:53.331448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:53.332405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:53.332858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:53.920890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:53.931463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f112a0e9-25a3-4817-b597-1c2879f7543f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1284 microversion: 2.1 time: 0.632170 Nov 24 17:50:53.932086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:53 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1284 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:53.968885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:53.969603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:54.001456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:54.004072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:54.013722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:54.013722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:54.903160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:54.926619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8bcefea0-8a92-419d-b466-2355e9357d6c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1214 microversion: 2.1 time: 0.961301 Nov 24 17:50:54.931677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:53 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1214 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:54.952509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:54.953296 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:54.994275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:54.994747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:54.997845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:54.998295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:55.516252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:55.527225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8e155807-133f-4588-93fa-6fe300499846 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1272 microversion: 2.1 time: 0.581179 Nov 24 17:50:55.541581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:54 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1272 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:55.946179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:55.946790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:55.967119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:55.967658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:55.968413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:55.968845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:56.551374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:56.552059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:56.572184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:56.572644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:56.579956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:56.580429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:57.167521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:57.188961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-20e4a7e6-6c57-4aeb-9926-70e0216edfe6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1276 microversion: 2.1 time: 1.239690 Nov 24 17:50:57.192989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:55 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1276 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:50:57.971752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:57.989780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6bf3355c-9a75-49c8-890e-a7fe58a3ef18 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 1.446366 Nov 24 17:50:57.990923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:56 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:58.204556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:58.205690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:58.220605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:58.222007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:58.226865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:58.227323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:58.633155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:58.654668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9a7c0328-d1a2-4d05-959a-581495c22a9e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1276 microversion: 2.1 time: 0.453510 Nov 24 17:50:58.664602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:58 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1276 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:59.006768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:59.007428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:59.024082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:59.024639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:59.026221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:59.027952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:59.502381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:50:59.517824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c117817-f48b-48d9-b1d0-4750a9356883 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.514740 Nov 24 17:50:59.518416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:59 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:50:59.674593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:50:59.675851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:50:59.689244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:59.690855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:50:59.692485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:50:59.694538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:00.539656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:00.540879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:00.563151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:00.565789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:00.567486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:00.572513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:00.875314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:00.895165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e689f2db-bf88-4ff6-9bd1-1bd63ab18812 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 1.220063 Nov 24 17:51:00.912276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 11/22] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:50:59 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:01.168708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:01.182351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f09eeebf-450b-4ef8-9076-055b8c0ab8d2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.648812 Nov 24 17:51:01.198362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:00 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:01.986363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1500732337", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d4cf1eb-a293-4cce-91dc-18c1bb4973c4"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:02.118376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'create', calling method: .version_select at 0x7f8b10b82940>, body: {"keypair": {"name": "tempest-keypair-551926811"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:02.146456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] validate_networks() for [('3d4cf1eb-a293-4cce-91dc-18c1bb4973c4', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:51:02.241126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:02.257073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:04.891694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:04.909378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:04.950595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d9037c30-3088-483c-82e2-29acde78a16a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 3.437232 Nov 24 17:51:04.959281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 13/24] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Nov 24 17:51:01 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 3448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:04.965697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:04.969208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:04.988744 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:04.991503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:04.992543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:04.996079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:05.496360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:51:05.497508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:51:05.500714 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:51:05.501400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:51:05.503274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:51:05.534338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:05.537074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:05.543694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:05.546294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:05.629568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Getting quotas for project 64f9bbe7d66843e4bdc67eed822136d5. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:05.652598 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Getting quotas for user dcb49727a87c45e29a57e7dcc0367c53 and project 64f9bbe7d66843e4bdc67eed822136d5. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:05.703875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:51:05.708088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:51:05.871361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d39d2f1d-b916-42b3-a369-59a3d8cd20be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.856066 Nov 24 17:51:05.880474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 12/25] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:51:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 4866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:51:05.895222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:05.900683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:05.902061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:05.913924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-73390b4b-b59f-4214-96f2-45eb727dad7a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.953486 Nov 24 17:51:05.924000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:04 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:05.927778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ca009445-109b-4738-8245-e35fe4e4b4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:05.928401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ca009445-109b-4738-8245-e35fe4e4b4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:05.938408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:05.941578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:05.942683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:05.943309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:06.598765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ca009445-109b-4738-8245-e35fe4e4b4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:06.608459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ca009445-109b-4738-8245-e35fe4e4b4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1222 microversion: 2.1 time: 0.686752 Nov 24 17:51:06.616380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 15/27] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1222 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:06.931498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:06.933366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:07.005757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:07.013784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:07.015712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:07.019781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:07.431456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:07.446483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-da887423-50dc-4514-b9ba-5819840b8aa7 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 1.563614 Nov 24 17:51:07.449392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 13/28] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:05 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:07.585668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-bffd9ad5-94bc-4429-b3e9-bad8b56d0619 req-d00c669d-a1dc-4919-81ed-d138f550461e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93283903-e620-4b25-9d9b-dd8df929bc16", "tag": "04235aaf-5ac9-4467-b036-cb16111e1bd9"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:07.588032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:07.588032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:07.601879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-bffd9ad5-94bc-4429-b3e9-bad8b56d0619 req-d00c669d-a1dc-4919-81ed-d138f550461e service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:07.602121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-bffd9ad5-94bc-4429-b3e9-bad8b56d0619 req-d00c669d-a1dc-4919-81ed-d138f550461e service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:07.622991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-bffd9ad5-94bc-4429-b3e9-bad8b56d0619 req-d00c669d-a1dc-4919-81ed-d138f550461e service nova] Creating event network-changed:04235aaf-5ac9-4467-b036-cb16111e1bd9 for instance 93283903-e620-4b25-9d9b-dd8df929bc16 on hv-cinder-81857 Nov 24 17:51:07.623503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-bffd9ad5-94bc-4429-b3e9-bad8b56d0619 req-d00c669d-a1dc-4919-81ed-d138f550461e service nova] Acquired lock "compute-rpcapi-router" {{(pid=100949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 24 17:51:07.624726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:07.625167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:07.626171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:07.626602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:07.640776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.compute.rpcapi [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Nov 24 17:51:07.641897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] Releasing lock "compute-rpcapi-router" {{(pid=100949) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 24 17:51:07.695144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-90ce3922-4c73-40f1-bc8d-0ee822eebe16 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242992 Nov 24 17:51:07.696088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:07.704144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-312777444", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d4cf1eb-a293-4cce-91dc-18c1bb4973c4"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:07.829352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] validate_networks() for [('3d4cf1eb-a293-4cce-91dc-18c1bb4973c4', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:51:07.957663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:07.969502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fb4c155b-0d82-4004-a7e8-3e2af8c41fba tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 1.040934 Nov 24 17:51:07.969502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 16/30] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:06 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:08.165875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-04374306-c159-414b-a8a2-130594674a9b req-baf99746-7dcb-44ec-8315-1a6c74bf1bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc68395-e919-48bd-a6c4-cbd0819044b7", "tag": "fc2fceee-7815-453b-ad43-7b8219deef3e"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:08.169248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:08.169248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:08.199991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-04374306-c159-414b-a8a2-130594674a9b req-baf99746-7dcb-44ec-8315-1a6c74bf1bac service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:08.200771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-04374306-c159-414b-a8a2-130594674a9b req-baf99746-7dcb-44ec-8315-1a6c74bf1bac service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:08.236730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-04374306-c159-414b-a8a2-130594674a9b req-baf99746-7dcb-44ec-8315-1a6c74bf1bac service nova] Creating event network-changed:fc2fceee-7815-453b-ad43-7b8219deef3e for instance afc68395-e919-48bd-a6c4-cbd0819044b7 on hv-cinder-81857 Nov 24 17:51:08.237463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-04374306-c159-414b-a8a2-130594674a9b req-baf99746-7dcb-44ec-8315-1a6c74bf1bac service nova] Acquired lock "compute-rpcapi-router" {{(pid=100948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 24 17:51:08.238870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:08.239328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:08.240144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:08.241401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:08.268668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.compute.rpcapi [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Nov 24 17:51:08.270592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] Releasing lock "compute-rpcapi-router" {{(pid=100948) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 24 17:51:08.338662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e5df5489-f4f4-404b-85c7-da7b25d33883 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367722 Nov 24 17:51:08.341492 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 17/31] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:08.467490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:08.468475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:08.499502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:08.501918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:08.503793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:08.506755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:09.016651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:51:09.022210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:51:09.022841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:51:09.025263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:51:09.026559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:51:09.056502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:09.058345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:09.060532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:09.063866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:09.128117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Getting quotas for project 64f9bbe7d66843e4bdc67eed822136d5. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:09.139091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Getting quotas for user dcb49727a87c45e29a57e7dcc0367c53 and project 64f9bbe7d66843e4bdc67eed822136d5. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:09.168291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:51:09.170755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:51:09.227824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:09.245651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cb09dc5a-6f4e-4333-ab90-f39bc44be2b4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.783783 Nov 24 17:51:09.270817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 18/32] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:08 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:09.270817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:09.270817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:09.295591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37d833d7-e961-44ed-a594-182315f3f082 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.596257 Nov 24 17:51:09.310049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 15/33] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:51:07 2021] POST /compute/v2.1/servers => generated 383 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:51:09.310874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:09.311445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:09.312618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:09.313350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:09.324941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-29f55fcd-9603-4153-b052-5b4481db49ec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:09.325645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-29f55fcd-9603-4153-b052-5b4481db49ec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:09.630361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-29f55fcd-9603-4153-b052-5b4481db49ec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:09.643767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-29f55fcd-9603-4153-b052-5b4481db49ec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1221 microversion: 2.1 time: 0.332302 Nov 24 17:51:09.644371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 16/34] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:09 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:09.956753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:09.976445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-84c4ab71-f202-437e-96f6-2f6d21a46f29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.711872 Nov 24 17:51:09.978560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 19/35] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:09 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:10.279417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:10.280076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:10.297423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:10.298339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:10.299455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:10.300061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:10.661157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:10.661781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:10.674987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:10.675628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:10.676721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:10.677481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:10.943034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:10.943426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:10.953301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fe3f6b93-a7d5-488e-83a7-ea26dd894c61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1217 microversion: 2.1 time: 0.295733 Nov 24 17:51:10.953930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 20/36] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:10 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1217 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:10.967778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f11a5bd4-dcbf-4800-a8e1-3218cd29f598 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.692882 Nov 24 17:51:10.978415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 17/37] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:10 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:10.998013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:10.998947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:11.007116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:11.007904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:11.008936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:11.009576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:11.971231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:11.972727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:11.993843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:11.996955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:11.997956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:12.000248 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:12.238566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:12.254501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8fec8aff-9195-46d9-a1ce-c6e8e09f155b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 1.263010 Nov 24 17:51:12.257872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 21/38] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:10 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:12.263301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:12.264502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:12.276878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:12.277335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:12.278121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:12.278560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:12.439103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:12.454397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b76b4c39-3679-4836-8a57-b71392f1499c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1279 microversion: 2.1 time: 0.486940 Nov 24 17:51:12.456553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 18/39] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:11 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1279 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:13.276998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:13.279114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:13.295755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:13.296422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:13.300080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:13.301219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:13.454032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:13.474635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1fdde38b-38cb-4a7f-b7de-ecabed8219df tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 1.214645 Nov 24 17:51:13.476286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:12 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:13.483354 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-51643577", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16d04825-809e-487e-b2a8-9c8ebe5605d4"}], "security_groups": [{"name": "tempest-securitygroup--1081214958"}], "key_name": "tempest-keypair-551926811", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:13.785383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:13.803626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-31e2df39-918a-425b-88e8-ea52d42c3216 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.530452 Nov 24 17:51:13.805746 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 19/41] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:13 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:13.830424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:13.832507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:13.848748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:13.849469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:13.851393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:13.852176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:13.940483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] validate_networks() for [('16d04825-809e-487e-b2a8-9c8ebe5605d4', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:51:14.054842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:14.069736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-28ae1f01-984a-4f4f-8522-1205a500d484 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1279 microversion: 2.1 time: 0.261799 Nov 24 17:51:14.084809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 20/42] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:13 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:14.492378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:14.492993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:14.501375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:14.501821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:14.502751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:14.503370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:14.928543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:14.948532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f4ce739b-1ead-4f7f-a8f6-fd99ab411fef tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.457588 Nov 24 17:51:14.949657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 21/43] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:14 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:14.956587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:14.957663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:14.968035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:14.968811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:14.969704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:14.970190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.330695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:51:15.331188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:51:15.331759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:51:15.332238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:51:15.332712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:51:15.340641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:15.346619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.347483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.348643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.349219 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.352296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2f83ad97-91fc-4989-a2ca-2ae4576f8d98 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.401354 Nov 24 17:51:15.352873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 22/44] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:14 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:15.359969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:15.360918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:15.371119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.371943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.373100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.373766 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.384391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:15.390191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:15.404387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:51:15.408607 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:51:15.514351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ca08cd17-f82c-4b13-87a1-21f528230b14 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.034831 Nov 24 17:51:15.515035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:51:13 2021] POST /compute/v2.1/servers => generated 402 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:51:15.550372 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9f07c48b-af8b-4a02-b353-6c1676f3ac69 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:15.554117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9f07c48b-af8b-4a02-b353-6c1676f3ac69 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:15.737581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:15.748131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b875ccaf-3cd4-4594-ba88-1532f2db242b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.392764 Nov 24 17:51:15.758599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 23/46] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:15 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:15.800873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9f07c48b-af8b-4a02-b353-6c1676f3ac69 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:15.812079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9f07c48b-af8b-4a02-b353-6c1676f3ac69 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1235 microversion: 2.1 time: 0.280045 Nov 24 17:51:15.824691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1235 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:15.970121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:15.971055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:15.989503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.990181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:15.991365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:15.991993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:16.370645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:16.371309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:16.402303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:16.402683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:16.404369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:16.404517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:16.605086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:16.617869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-15b304b6-823a-4cbd-b856-68c9b3b887f1 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.655854 Nov 24 17:51:16.624287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:15 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:16.771048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:16.772543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:16.781493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:16.781940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:16.782892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:16.783336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:17.585221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:17.597105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c59e12bd-2218-44d7-90b0-1c1ef717bcf8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.834970 Nov 24 17:51:17.599812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 25/49] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:16 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:17.606920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:17.611096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:17.625891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:17.626307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:17.627076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:17.627504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:17.693850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:17.703540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fc60b323-9295-48fa-a70c-42e1ae622f53 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 1.337200 Nov 24 17:51:17.711944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:16 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:17.720081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:17.721186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:17.751093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:17.751777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:17.752757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:17.753375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:18.294375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:18.314243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7ab17ac7-b1d1-4608-8c5d-f8ab9119e8bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1293 microversion: 2.1 time: 0.713288 Nov 24 17:51:18.314825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 26/51] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1293 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:18.617940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:18.618858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:18.645551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:18.646002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:18.646894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:18.647325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:19.005784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:19.016069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c00b7cda-3100-4ed3-a49b-54ced2cc61a2 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 1.302758 Nov 24 17:51:19.020284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 26/52] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:17 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:19.037419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:19.038320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:19.052628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:19.052868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:19.054885 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:19.057081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:19.948209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:19.961194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cf048cff-9105-400b-a7e4-5b120b5d2867 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 1.348952 Nov 24 17:51:19.974133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 27/53] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:18 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:19.987454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:19.988622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:20.018619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.022376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.023554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.025945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.480502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:20.490528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3a0aaf26-5682-4718-9dba-beaff9dac2f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 1.458979 Nov 24 17:51:20.491114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 27/54] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:19 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:20.511416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-5ad1b8eb-284c-4226-bb5e-36f11b2943d9 req-c907b7c7-a869-45db-a409-5de6dc330cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d195ce54-bd42-4deb-b7de-c80fcfcd3437", "tag": "8b9bafad-9e4a-4de0-a61c-31c30b5ff84b"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:20.518262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:20.518262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:20.538068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-5ad1b8eb-284c-4226-bb5e-36f11b2943d9 req-c907b7c7-a869-45db-a409-5de6dc330cc1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.542404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-5ad1b8eb-284c-4226-bb5e-36f11b2943d9 req-c907b7c7-a869-45db-a409-5de6dc330cc1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.593659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-5ad1b8eb-284c-4226-bb5e-36f11b2943d9 req-c907b7c7-a869-45db-a409-5de6dc330cc1 service nova] Creating event network-changed:8b9bafad-9e4a-4de0-a61c-31c30b5ff84b for instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 on hv-cinder-81857 Nov 24 17:51:20.613899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-5ad1b8eb-284c-4226-bb5e-36f11b2943d9 req-c907b7c7-a869-45db-a409-5de6dc330cc1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112997 Nov 24 17:51:20.618074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 28/55] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:20.633445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:20.636829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:20.649838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.650577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.652004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.659957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.817238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:20.840497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9802e611-211e-4337-8cef-ab3664e47cc0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.864967 Nov 24 17:51:20.841409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 28/56] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:20.938660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-351b497b-3f9a-4c5e-84e2-3eb5b021586a req-baae08a6-b2cd-408d-8982-cbd306e53ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc68395-e919-48bd-a6c4-cbd0819044b7", "name": "network-vif-plugged", "status": "completed", "tag": "fc2fceee-7815-453b-ad43-7b8219deef3e"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:20.940393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:20.940393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:20.957492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-351b497b-3f9a-4c5e-84e2-3eb5b021586a req-baae08a6-b2cd-408d-8982-cbd306e53ddf service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:20.960520 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-351b497b-3f9a-4c5e-84e2-3eb5b021586a req-baae08a6-b2cd-408d-8982-cbd306e53ddf service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:20.986962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-351b497b-3f9a-4c5e-84e2-3eb5b021586a req-baae08a6-b2cd-408d-8982-cbd306e53ddf service nova] Creating event network-vif-plugged:fc2fceee-7815-453b-ad43-7b8219deef3e for instance afc68395-e919-48bd-a6c4-cbd0819044b7 on hv-cinder-81857 Nov 24 17:51:20.991907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-351b497b-3f9a-4c5e-84e2-3eb5b021586a req-baae08a6-b2cd-408d-8982-cbd306e53ddf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146830 Nov 24 17:51:20.992653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 29/57] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:20.998531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-420c47bb-e94e-466f-8dcb-293f255ad030 req-28051a62-462f-487f-a4b3-5d94791e3abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f00b1d-a746-4496-a338-1a6ca81f15c7", "tag": "ba45d7ce-4681-4fd8-b019-1ea1b0526b2b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:21.000192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:21.000192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:21.014991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-420c47bb-e94e-466f-8dcb-293f255ad030 req-28051a62-462f-487f-a4b3-5d94791e3abb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.015542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-420c47bb-e94e-466f-8dcb-293f255ad030 req-28051a62-462f-487f-a4b3-5d94791e3abb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.034791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-420c47bb-e94e-466f-8dcb-293f255ad030 req-28051a62-462f-487f-a4b3-5d94791e3abb service nova] Creating event network-changed:ba45d7ce-4681-4fd8-b019-1ea1b0526b2b for instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 on hv-cinder-81857 Nov 24 17:51:21.040269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-420c47bb-e94e-466f-8dcb-293f255ad030 req-28051a62-462f-487f-a4b3-5d94791e3abb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046059 Nov 24 17:51:21.042306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:21.051276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:21.052004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:21.060990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.061437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.062269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.062633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.069745 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:21.079335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d64116ff-0a85-401a-a6fb-59beca1c021c tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.456765 Nov 24 17:51:21.081866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:20 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:21.281227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:21.289973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-05081ae4-4838-4c61-83ea-10e1585f24e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.242517 Nov 24 17:51:21.290663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 31/60] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:21 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:21.508186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:21.508903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:21.516933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.517379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.518260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.518696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.772731 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:21.780679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b91fc221-4e5b-4a3a-9f96-664ba5376fdf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.276699 Nov 24 17:51:21.781246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 30/61] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:21 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:21.859136 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:21.859796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:21.866936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.867375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:21.868153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:21.868580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.065072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:22.073318 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0495a6da-0fe8-4fcf-a67e-ac92bace870c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.217803 Nov 24 17:51:22.073882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 32/62] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:22.098207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:22.098844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:22.106985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.107448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.108718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.108718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.300389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:22.307707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:22.308319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:22.309110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c3fca474-7cda-47a6-99d6-8adfcf91827a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.214798 Nov 24 17:51:22.309684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:22 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:22.315397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.315828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.316607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.317092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.520753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:22.529940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3653c6e3-a155-4636-9772-c70d0be99bd6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.225664 Nov 24 17:51:22.530577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 33/64] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:22 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:22.634014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-d6d34fbe-26e7-460d-999c-b2ba03f2aec1 req-d796b032-23f9-4618-a24a-e8e4e8b19f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fbcf33-86b7-4b2f-9a5d-9c87da78fc27", "tag": "2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:22.636472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:22.636472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:22.645157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-d6d34fbe-26e7-460d-999c-b2ba03f2aec1 req-d796b032-23f9-4618-a24a-e8e4e8b19f5a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.645624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-d6d34fbe-26e7-460d-999c-b2ba03f2aec1 req-d796b032-23f9-4618-a24a-e8e4e8b19f5a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.661549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-d6d34fbe-26e7-460d-999c-b2ba03f2aec1 req-d796b032-23f9-4618-a24a-e8e4e8b19f5a service nova] Creating event network-changed:2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d for instance 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 on hv-cinder-81857 Nov 24 17:51:22.666354 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-d6d34fbe-26e7-460d-999c-b2ba03f2aec1 req-d796b032-23f9-4618-a24a-e8e4e8b19f5a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036197 Nov 24 17:51:22.666950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 32/65] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:51:22.797543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:22.798168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:22.805559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.806006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:22.807205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:22.807651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.008454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:23.017485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-27f0204a-3bbe-49ca-bb05-a2f30b96d83e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.223530 Nov 24 17:51:23.018067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:22 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:23.091088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:23.091954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:23.099416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.099905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.100664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.101098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.311759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:23.321201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-20453739-55dc-440f-a974-e891298b501a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.234707 Nov 24 17:51:23.330626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:23.330626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:23.331572 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 33/67] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:23.334377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.334822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.335580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.336054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.552691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:23.555473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:23.578640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.579364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.582137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:23.584755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:23.755247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:23.765518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c59bedbf-fe36-48ec-90da-d67e85944d01 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.443377 Nov 24 17:51:23.769401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 35/68] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:23 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:24.034465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:24.035301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:24.046339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.049373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:24.050172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.050608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:24.334925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:24.349904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2a67d929-45ac-4384-b0dc-b91234da869f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.313875 Nov 24 17:51:24.350754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 36/69] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:24 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:24.356610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:24.357301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:24.368674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.370249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:24.370595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:24.371712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.372319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:24.380682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a9bb1ec3-5e16-4953-9f39-484dc67079f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.837668 Nov 24 17:51:24.389966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 34/70] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:23 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:24.638997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:24.648967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1443250e-55bc-4a15-ae4b-2b2be8dce8e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.296977 Nov 24 17:51:24.649531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 37/71] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:24.786918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:24.787521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:24.796769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.797211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:24.797980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:24.798402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.024951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:25.034901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fd1704d2-6461-4cb5-9547-03e0da9c7901 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.251463 Nov 24 17:51:25.035476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 35/72] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:24 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:25.367870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:25.375901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:25.375901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.376173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.376936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.377363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.398560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:25.400067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:25.410272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.411042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.414075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.414075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.593182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:25.601448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e4b2f187-4f3a-41ea-a262-7e970d09a3cc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.237255 Nov 24 17:51:25.602001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 38/73] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:25 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:25.625970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:25.634142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7fb37098-a76f-42db-80ea-bd3f4278c550 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.240210 Nov 24 17:51:25.635518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 36/74] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:25 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:25.665477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:25.666777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:25.673414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.673824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.674580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:25.675006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:25.881419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:25.890155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-90c3c2d5-c488-4ad1-a84a-4d44c828b5d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.228256 Nov 24 17:51:25.890947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 39/75] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:26.028746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-2c577c2d-cceb-42ba-8f60-09f03695d825 req-ac68c4da-8070-4bc0-8c9f-2d61006a5086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93283903-e620-4b25-9d9b-dd8df929bc16", "name": "network-vif-plugged", "status": "completed", "tag": "04235aaf-5ac9-4467-b036-cb16111e1bd9"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:26.031867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:26.031867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:26.044276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-2c577c2d-cceb-42ba-8f60-09f03695d825 req-ac68c4da-8070-4bc0-8c9f-2d61006a5086 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.044962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-2c577c2d-cceb-42ba-8f60-09f03695d825 req-ac68c4da-8070-4bc0-8c9f-2d61006a5086 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.055077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:26.055952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:26.071300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.072585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.073535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.076019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.094046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-2c577c2d-cceb-42ba-8f60-09f03695d825 req-ac68c4da-8070-4bc0-8c9f-2d61006a5086 service nova] Creating event network-vif-plugged:04235aaf-5ac9-4467-b036-cb16111e1bd9 for instance 93283903-e620-4b25-9d9b-dd8df929bc16 on hv-cinder-81857 Nov 24 17:51:26.102361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-2c577c2d-cceb-42ba-8f60-09f03695d825 req-ac68c4da-8070-4bc0-8c9f-2d61006a5086 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080159 Nov 24 17:51:26.104576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 37/76] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:26.289276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:26.298340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b4de92b9-5f39-4eb2-957c-e2a81f4f4cbd tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.249064 Nov 24 17:51:26.298897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 40/77] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:26 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:26.618667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:26.620144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:26.627551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.628031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.628776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.629198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.652417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:26.653282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:26.661019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.661577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:26.662455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:26.663007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:27.071205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:27.085883 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-24907855-c62c-4ee4-957b-96e724abc90e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.437480 Nov 24 17:51:27.086475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 41/78] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:26 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:27.141438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:27.150765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:27.170620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:27.171456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:27.172673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:27.173490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:27.393400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:27.402907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-503710f4-91a2-4242-b370-f293469e42e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.788354 Nov 24 17:51:27.403403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 38/79] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:26 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:27.433345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:27.434136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:27.459738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:27.460521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:27.461651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:27.462328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:27.530680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:27.545597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-00bc94df-3b6c-4083-a72b-eb2498c234b7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.440255 Nov 24 17:51:27.548337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 42/80] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:27.795768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:27.805827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e76c8ff2-b70d-4d7f-96a2-5ee7ef800f3a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.375723 Nov 24 17:51:27.805827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 39/81] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:27 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:28.172326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:28.172953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:28.180776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.181814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.182798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.183251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.379565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:28.389757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e275868c-2d21-4e30-8a5f-958c98c2e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.221351 Nov 24 17:51:28.390331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 43/82] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:28 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:28.419734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:28.420346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:28.427643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.428096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.428859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.429292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.565059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:28.565654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:28.574960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.575403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.576276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.576700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.625099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:28.633010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5f05fc0b-90f9-40bd-822d-0fe20e5d0fc4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.217950 Nov 24 17:51:28.633569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 40/83] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:28 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:28.779929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:28.787961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-288e69be-d488-4cbd-86ce-ea8cb67d343e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.226592 Nov 24 17:51:28.788525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 44/84] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:28.824453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:28.825088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:28.832340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.832783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:28.833542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:28.833973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.027209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:29.035243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aec907c0-eed0-4bb5-862f-3810a491d8ff tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.214455 Nov 24 17:51:29.035833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 41/85] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:28 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:29.406865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:29.407470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:29.417356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.417705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.418481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.418911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.612990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:29.622025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f1eead74-b12c-4b66-8f60-a77ddb73eb5d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.218812 Nov 24 17:51:29.622589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 45/86] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:29 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:29.648751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:29.649347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:29.656704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.657143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.657897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.658321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.805621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:29.806802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:29.814735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.815106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.815888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:29.816313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:29.856240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:29.864291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4f0180d7-f879-48d9-be45-b086c0a851b8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.219164 Nov 24 17:51:29.864854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 42/87] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:29 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:30.053759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:30.054493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:30.062773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.063226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:30.064061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.064357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:30.064485 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:30.073055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6dbe382c-bd2b-49ad-911f-4f220c094207 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.271003 Nov 24 17:51:30.079560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 46/88] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:30.256103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:30.265911 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8522bdfa-7e20-4395-aa75-305d5c93536d tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.216182 Nov 24 17:51:30.266496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 43/89] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:30 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:30.638366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:30.638928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:30.646076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.646514 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:30.647279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.647744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:30.848122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:30.856851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f54f7e31-b572-4cf7-8b8f-cc275074f72a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.222488 Nov 24 17:51:30.857439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 47/90] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:30 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:30.881274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:30.882108 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:30.890088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.890471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:30.891229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:30.891680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.090390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:31.091001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:31.095703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:31.098162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.098610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.099381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.099840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.104953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d0e956be-0e0f-48e9-9c8b-bbae9a285995 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.227284 Nov 24 17:51:31.105520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 44/91] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:30 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:31.282271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:31.282869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:31.289935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.290380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.292021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.292453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.302271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:31.310437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2c9e2644-f346-4cd4-9132-964d73c91c30 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.224154 Nov 24 17:51:31.310995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 48/92] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:31.497076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:31.507168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-513b9290-d79f-4ea8-90a1-7c41f8ff282f tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.228167 Nov 24 17:51:31.517729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 45/93] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:31 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:31.873685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:31.874285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:31.881352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.881789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:31.882533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:31.882987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.090150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:32.098452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e5798be4-5bec-4408-b448-243cb5c24a38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.228356 Nov 24 17:51:32.099029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 49/94] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:31 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:32.122155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:32.122759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:32.129939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.130386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.131145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.131574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.327733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:32.332078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:32.343589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.347183 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.348009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.348439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.400355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:32.408631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1daba77e-ee23-4231-9b22-a494e5c19359 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.290750 Nov 24 17:51:32.409401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 46/95] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:32 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:32.524507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:32.525766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:32.533710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.534123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.535027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:32.535434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:32.610181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:32.619648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-af9451e1-74d1-477f-8a32-e8e9b40f69a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.295295 Nov 24 17:51:32.624370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 50/96] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:32.739937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:32.748396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d92fa2eb-b162-4fa6-96ed-6a5cea4db262 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.227591 Nov 24 17:51:32.749052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 47/97] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:32 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:33.115576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:33.116197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:33.123875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.124320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.125083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.125511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.353980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:33.363417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b310c3e7-328c-48a9-8962-9fd865831b4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.251410 Nov 24 17:51:33.364359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 51/98] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:33 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:33.426401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:33.427005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:33.434268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.434978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.435750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.436466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.636479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:33.637415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:33.653143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.653907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.654968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.655824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.895143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:33.904977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-454dbe27-f06d-4871-90c7-c7b2c1d23c68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.272203 Nov 24 17:51:33.908333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 52/99] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:33.913201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:33.913990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:33.922787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.923231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:33.924047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:33.924640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:34.167822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:34.178677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-38d69d3c-bf7b-483f-99be-c5286c5615ce tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1314 microversion: 2.1 time: 0.269071 Nov 24 17:51:34.179255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 53/100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:33 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:34.251105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:34.260464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-316b1d33-1b6b-4c92-a54f-0fc677fe00e8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1318 microversion: 2.1 time: 0.837092 Nov 24 17:51:34.261301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 48/101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:33 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1318 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:34.382790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:34.383399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:34.391712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:34.392343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:34.393282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:34.393865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:34.758843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:34.769292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26d57413-92a7-40bf-a518-3ac1f14fdd80 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.390041 Nov 24 17:51:34.771365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 54/102] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:34 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:34.924840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:34.925517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:34.954060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:34.956602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:34.959200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:34.960013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.200452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:35.201752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:35.221414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.223882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.226472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.227490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.450866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:35.462100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-94b7171d-83b5-4ec7-8322-55200d899f98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.541213 Nov 24 17:51:35.463932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 49/103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:35.470445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:35.471330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:35.481947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.482718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.483888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.484557 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.680545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:35.693925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-951b9b63-6816-486c-90e4-b95f1c149910 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1502 microversion: 2.1 time: 0.497875 Nov 24 17:51:35.696005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 55/104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:35 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1502 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:35.789350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:35.789962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:35.804961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.805431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.809796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:35.813264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:35.909149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:35.938845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9761e7ba-6ab7-48b5-9e09-357498e742f0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1509 microversion: 2.1 time: 0.473374 Nov 24 17:51:35.953926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 50/105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:35 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:36.215764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:36.239783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aca75232-36d0-4a2a-895e-7c04d49527eb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.455198 Nov 24 17:51:36.243104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 56/106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:35 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:36.481196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:36.482084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:36.498210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:36.499005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:36.500850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:36.501384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:36.976678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:36.989032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8d27cd0-1dc6-4a83-b71b-1bf1f1f31326 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.512527 Nov 24 17:51:37.001630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 51/107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:37.264284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:37.265822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:37.276058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.276619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:37.278102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.278798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:37.573190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:37.592908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d328626d-4dbd-4a33-a3c1-6f2005613291 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.338491 Nov 24 17:51:37.595352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 57/108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:37 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:37.820715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e5ca870-55a3-4cc3-979f-0a5a629edb1c"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:37.822231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:37.829977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.830858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:37.832012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.832660 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:37.953845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202de15c-5965-47a6-b14b-252975f0a645"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:37.955039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:37.970115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.974968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:37.976151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:37.980364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:38.344101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5fc7d3b6-8562-4005-96d2-af6776c76a89 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "POST /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.526426 Nov 24 17:51:38.345500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 52/109] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:51:37 2021] POST /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7/os-volume_attachments => generated 194 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:38.352264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:38.353456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:38.364401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:38.365484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:38.368151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:38.369037 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:38.670686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:38.686780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ac4bbc1-6cc0-44d8-82e0-b46fe47afdab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.338306 Nov 24 17:51:38.687983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 53/110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:38.694413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:38.695248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:38.716780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:38.717304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:38.718299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:38.718741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:38.822277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2291e4d1-e420-437d-9a86-664f86bc4e5d tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871830 Nov 24 17:51:38.823684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 58/111] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:51:37 2021] POST /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:38.990600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:39.004109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0873c16e-2398-4bde-8b00-ee10204ded09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.314446 Nov 24 17:51:39.007751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 54/112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:38 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:39.706518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:39.707379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:39.717105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:39.717732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:39.718705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:39.719464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:39.861227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-a4025bfa-5b70-467c-89da-057f37cc5593 req-ebff2a98-1ad1-4166-bc23-60129ed21c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d195ce54-bd42-4deb-b7de-c80fcfcd3437", "name": "network-vif-plugged", "status": "completed", "tag": "8b9bafad-9e4a-4de0-a61c-31c30b5ff84b"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:39.864526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:39.864526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:39.878388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a4025bfa-5b70-467c-89da-057f37cc5593 req-ebff2a98-1ad1-4166-bc23-60129ed21c63 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:39.878806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a4025bfa-5b70-467c-89da-057f37cc5593 req-ebff2a98-1ad1-4166-bc23-60129ed21c63 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:39.903149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-a4025bfa-5b70-467c-89da-057f37cc5593 req-ebff2a98-1ad1-4166-bc23-60129ed21c63 service nova] Creating event network-vif-plugged:8b9bafad-9e4a-4de0-a61c-31c30b5ff84b for instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 on hv-cinder-81857 Nov 24 17:51:39.925913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-a4025bfa-5b70-467c-89da-057f37cc5593 req-ebff2a98-1ad1-4166-bc23-60129ed21c63 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072700 Nov 24 17:51:39.927366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 55/113] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:39.989945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:40.002576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a982c620-9a54-4ec8-96fa-2d8e16c9911d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.301602 Nov 24 17:51:40.003169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 59/114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:40.022409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:40.023105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:40.039192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:40.042182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:40.042999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:40.044784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:40.502116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:40.511168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aff9f2ef-fab8-496c-a07f-10d90699f014 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.493064 Nov 24 17:51:40.520262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 56/115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:40 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:41.025858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:41.028244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:41.040993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:41.041855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:41.042845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:41.043266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:41.372865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:41.380853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26de922e-8517-4ee6-9c1f-dbf40888f445 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.364397 Nov 24 17:51:41.381588 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 60/116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:41.528522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:41.529213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:41.536457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:41.536895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:41.537652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:41.538075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:41.752879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:41.762025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-acb5b82d-28a1-47dc-8927-eda6ca195aed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.238010 Nov 24 17:51:41.762542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 57/117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:41 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:42.010042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-80ece26a-38c3-4097-985f-df4993000d32 req-f7284a31-0ed0-4973-b680-e8c3e3593bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f00b1d-a746-4496-a338-1a6ca81f15c7", "name": "network-vif-plugged", "status": "completed", "tag": "ba45d7ce-4681-4fd8-b019-1ea1b0526b2b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:42.012346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:42.012346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:42.021705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-80ece26a-38c3-4097-985f-df4993000d32 req-f7284a31-0ed0-4973-b680-e8c3e3593bb1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:42.022164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-80ece26a-38c3-4097-985f-df4993000d32 req-f7284a31-0ed0-4973-b680-e8c3e3593bb1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:42.043226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-80ece26a-38c3-4097-985f-df4993000d32 req-f7284a31-0ed0-4973-b680-e8c3e3593bb1 service nova] Creating event network-vif-plugged:ba45d7ce-4681-4fd8-b019-1ea1b0526b2b for instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 on hv-cinder-81857 Nov 24 17:51:42.048468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-80ece26a-38c3-4097-985f-df4993000d32 req-f7284a31-0ed0-4973-b680-e8c3e3593bb1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Nov 24 17:51:42.049196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 61/118] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:42.398738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:42.400472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:42.414288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:42.418199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:42.420865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:42.423396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:42.675846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:42.686833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4bd4d1dc-c4ea-437c-9886-d49ed073cf77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.292401 Nov 24 17:51:42.687648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 58/119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:42.779561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:42.780587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:42.789707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:42.791628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:42.792844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:42.793632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:43.038676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:43.049995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9c5227b8-1bf9-40de-af0c-15be5ae7eae1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.275270 Nov 24 17:51:43.050927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 62/120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:42 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:43.703803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:43.704472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:43.711593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:43.712351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:43.713218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:43.713641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:43.915313 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:43.923905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6532b1f2-bbc3-4e30-b278-342c268a936a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.223763 Nov 24 17:51:43.924473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 59/121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:44.066230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-8ba4edef-85af-4c5a-b8e2-60b305253345 req-704c4e46-99dd-4e8e-9ec9-4f075d63a245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fbcf33-86b7-4b2f-9a5d-9c87da78fc27", "name": "network-vif-plugged", "status": "completed", "tag": "2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:44.069368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:44.069368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:44.070761 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:44.074521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:44.082148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-8ba4edef-85af-4c5a-b8e2-60b305253345 req-704c4e46-99dd-4e8e-9ec9-4f075d63a245 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:44.082910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-8ba4edef-85af-4c5a-b8e2-60b305253345 req-704c4e46-99dd-4e8e-9ec9-4f075d63a245 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:44.092700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:44.093148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:44.093926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:44.105072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:44.110695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-8ba4edef-85af-4c5a-b8e2-60b305253345 req-704c4e46-99dd-4e8e-9ec9-4f075d63a245 service nova] Creating event network-vif-plugged:2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d for instance 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 on hv-cinder-81857 Nov 24 17:51:44.118869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-8ba4edef-85af-4c5a-b8e2-60b305253345 req-704c4e46-99dd-4e8e-9ec9-4f075d63a245 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058629 Nov 24 17:51:44.120074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 63/122] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:44.527970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:44.538189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-09f4531a-6de8-4ee6-bd71-da37cab12b7b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.473972 Nov 24 17:51:44.539573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 60/123] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:44 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:44.945025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:44.946107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:44.957697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:44.960516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:44.963826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:44.964425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:45.298249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:45.310511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c2f454ff-1c85-4348-ac2b-0d39d3f9983a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1361 microversion: 2.1 time: 0.372429 Nov 24 17:51:45.311074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 64/124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:45.559026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:45.559846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:45.567292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:45.567884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:45.569222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:45.569872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:45.873692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:45.882321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ee9eca97-dde2-4740-977c-a4a4925971c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1321 microversion: 2.1 time: 0.329201 Nov 24 17:51:45.882976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 61/125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:45 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:46.327946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:46.328613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:46.336245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.336654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.337972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.338637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.683642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:46.695446 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5c9f2e5d-8438-4791-906e-b4885ab8607e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1545 microversion: 2.1 time: 0.371086 Nov 24 17:51:46.698131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 65/126] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1545 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:46.715946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:46.717174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:46.729347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.730771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.731703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.732503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.902852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:46.904469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:46.913119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.913913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.914825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:46.916008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:46.956036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-920c2555-4c3b-4bad-9108-8735d51507ad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247037 Nov 24 17:51:46.956609 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 62/127] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Nov 24 17:51:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:47.766625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:47.778331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f258b013-ae07-4cf7-9cc6-b736c43d0085 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1516 microversion: 2.1 time: 0.879832 Nov 24 17:51:47.781713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 66/128] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:46 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1516 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:47.801452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:47.801452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:47.810353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:47.810739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:47.811582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:47.812094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:47.881054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lazy-loading 'flavor' on Instance uuid 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:51:48.052828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-db54a7d4-984f-4fe5-bc7d-66b36f396eff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27/action" status: 200 len: 32 microversion: 2.1 time: 0.257232 Nov 24 17:51:48.059803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 63/129] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:47 2021] POST /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:48.064366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:48.065216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:48.072920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:48.073447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:48.074462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:48.075171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:48.813260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:48.825105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ed3f197e-7b29-40ee-90c0-5fb0f0fdb889 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.764380 Nov 24 17:51:48.826219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 67/130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:48 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:49.000623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:49.001823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:49.012525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.014040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.015213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.015975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.114167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 17:51:49.290774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c917c146-03ac-4f73-b289-0f3489ec1d99 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 204 len: 0 microversion: 2.1 time: 0.294045 Nov 24 17:51:49.304005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 64/131] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 17:51:48 2021] DELETE /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 17:51:49.313295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:49.314138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:49.330099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.330448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.331543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.332132 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.784243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:49.785947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:49.846287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:49.854413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.854855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.855668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.856099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.857901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f34b43f3-2b1f-4251-9ee4-6bbb23c5bc8a tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1554 microversion: 2.1 time: 0.548486 Nov 24 17:51:49.858712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 68/132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:49 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1554 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:49.863200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-8590af89-d8f7-468b-87de-db322c7c4add req-5bad3d86-e120-4a09-a15d-a7d00bb6ce9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f00b1d-a746-4496-a338-1a6ca81f15c7", "tag": "ba45d7ce-4681-4fd8-b019-1ea1b0526b2b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:49.864925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:49.864925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:51:49.874253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-8590af89-d8f7-468b-87de-db322c7c4add req-5bad3d86-e120-4a09-a15d-a7d00bb6ce9e service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.874895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-8590af89-d8f7-468b-87de-db322c7c4add req-5bad3d86-e120-4a09-a15d-a7d00bb6ce9e service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.892591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-8590af89-d8f7-468b-87de-db322c7c4add req-5bad3d86-e120-4a09-a15d-a7d00bb6ce9e service nova] Creating event network-changed:ba45d7ce-4681-4fd8-b019-1ea1b0526b2b for instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 on hv-cinder-81857 Nov 24 17:51:49.901504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-8590af89-d8f7-468b-87de-db322c7c4add req-5bad3d86-e120-4a09-a15d-a7d00bb6ce9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041583 Nov 24 17:51:49.916734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 69/133] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:51:49.922487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:49.923485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:49.931886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.932650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:49.933725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:49.934423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:50.076472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-eabfcbe9-f348-4581-a941-44059d81c08d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.298586 Nov 24 17:51:50.077999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 65/134] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:49 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 17:51:50.274405 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:50.284032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f10ccfa3-d140-4292-b44b-805f549a61c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.365696 Nov 24 17:51:50.294861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:49 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:50.876550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:50.877296 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:50.892976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:50.893455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:50.894823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:50.894988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:51.088957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:51.090147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:51.103251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:51.105752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:51.106946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:51.109278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:51.299015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c5a6547f-389c-4aaa-b6b4-d75d5bba40aa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.213681 Nov 24 17:51:51.300126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 71/136] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:51 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:51.319584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:51.322068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:51.337281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:51.337985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:51.339051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:51.339928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:51.902511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:51.917626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c22012d2-42aa-463f-b103-e26ffdff586b tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1554 microversion: 2.1 time: 1.046510 Nov 24 17:51:51.920640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 66/137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:50 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1554 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:52.045876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:52.057447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-032288db-c42e-4b3f-8499-b199df8ee281 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.755588 Nov 24 17:51:52.069402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 72/138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:51 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:52.310428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:52.311391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:52.329600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:52.330161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:52.340658 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:52.341104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:52.540008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90b7c7d8-b9fa-4fd8-b703-5ab84a66d567 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.230294 Nov 24 17:51:52.542130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 67/139] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:52 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:52.941716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:52.943673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:52.959280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:52.959749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:52.964630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:52.965260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.075064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-64a8fb46-d0e6-46ea-b141-2e3d5c3308a0 req-072fcd20-2559-46f4-a4fd-4d5701fb0c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc68395-e919-48bd-a6c4-cbd0819044b7", "name": "network-vif-deleted", "tag": "fc2fceee-7815-453b-ad43-7b8219deef3e"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:53.076639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:51:53.076639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:51:53.105329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-64a8fb46-d0e6-46ea-b141-2e3d5c3308a0 req-072fcd20-2559-46f4-a4fd-4d5701fb0c32 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:53.105782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-64a8fb46-d0e6-46ea-b141-2e3d5c3308a0 req-072fcd20-2559-46f4-a4fd-4d5701fb0c32 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.126001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-64a8fb46-d0e6-46ea-b141-2e3d5c3308a0 req-072fcd20-2559-46f4-a4fd-4d5701fb0c32 service nova] Creating event network-vif-deleted:fc2fceee-7815-453b-ad43-7b8219deef3e for instance afc68395-e919-48bd-a6c4-cbd0819044b7 on hv-cinder-81857 Nov 24 17:51:53.131562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-64a8fb46-d0e6-46ea-b141-2e3d5c3308a0 req-072fcd20-2559-46f4-a4fd-4d5701fb0c32 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063200 Nov 24 17:51:53.134530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 68/140] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 24 17:51:53.141376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:53.142640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:53.157462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:53.158403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.159431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:53.160237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.232399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:53.244020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e3bd5110-15c9-458d-84ed-c58c0fc64673 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1512 microversion: 2.1 time: 0.307659 Nov 24 17:51:53.245068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 73/141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:52 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:53.440764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:53.459925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-94046cb8-e765-423b-8228-7bbab7ea856d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.323417 Nov 24 17:51:53.460822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 69/142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:53 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:53.548594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:53.549536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:53.561537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:53.561989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.562770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:53.563200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:53.681079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9f67d5d9-a4b9-4f90-9047-d94a7d674cb0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.134760 Nov 24 17:51:53.682511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 74/143] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:53 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:54.261705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:54.262389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:54.270406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.271067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.272057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.272671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.375405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.375972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.376497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lazy-loading 'fault' on Instance uuid afc68395-e919-48bd-a6c4-cbd0819044b7 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:51:54.466867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d6500bb8c46b0afad0048d9bac713', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf323d9d7dd42c7bfe427677fe26584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:54.480117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:54.480909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:54.496692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-26203031-93a9-419c-b64e-053e15e36066 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 200 len: 1350 microversion: 2.1 time: 0.239051 Nov 24 17:51:54.497584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 70/144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:54 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 1350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:54.500972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.511846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.514533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.514995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.692424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:54.693853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:54.701346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.702303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.703155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:54.703998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:54.806927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:54.815204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ea9bd38d-6b6a-4ab6-a409-340fb2fec3a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.340338 Nov 24 17:51:54.815800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 75/145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:54 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:54.828782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ad88e193-10e4-4842-91a8-4e825c3d5191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.139817 Nov 24 17:51:54.832032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 71/146] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:54 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 17:51:55.527722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:55.529161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:55.542852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.543511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:55.544527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.545223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:55.603916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] HTTP exception thrown: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. Nov 24 17:51:55.604670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Returning 404 to user: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:51:55.605599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a85ae21b-7214-4a91-9cb5-cfa426254dc5 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 404 len: 111 microversion: 2.1 time: 0.084536 Nov 24 17:51:55.606408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 76/147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:55 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:51:55.837706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:55.839079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:55.841385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:55.844021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:55.855994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.856905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:55.858064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.858184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.858685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:55.858991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:55.859535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:55.860000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:56.029645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3b6e7c4a-a7c6-43dc-a5ee-02dfc1cfafea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.189089 Nov 24 17:51:56.033770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 77/148] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:55 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:56.040854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-55898572", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "d999ad69-34a5-4430-8f01-a48e3a42bfc5"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:56.145401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] validate_networks() for [('d999ad69-34a5-4430-8f01-a48e3a42bfc5', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:51:56.189797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:56.202107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3690722d-1e98-4991-a363-737e0a7810d6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.371927 Nov 24 17:51:56.212441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 72/149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:55 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:56.216876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:56.218204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:56.225673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:56.226118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:56.226936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:56.228331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:56.276528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] HTTP exception thrown: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. Nov 24 17:51:56.277174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Returning 404 to user: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:51:56.277993 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a639041c-8ee1-4f4b-99e2-d41b233e6ad4 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.074578 Nov 24 17:51:56.282261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 73/150] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:51:56 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:51:56.904436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:51:56.904964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:51:56.905302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:51:56.905680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:51:56.906175 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:51:56.916962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:56.917403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:56.918178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:56.918767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:56.939915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:51:56.944103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for user 6a81c70350ee4996b85c33ec8fedaa55 and project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:51:56.956529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:51:56.959400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:51:57.043042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-57302e46-4ab3-49b4-b13f-271d5ee2a7b4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007860 Nov 24 17:51:57.043695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 78/151] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:51:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:51:57.060943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:57.062743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:57.080480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f6889718-f345-4d73-b061-d39126e36b31 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:57.082903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f6889718-f345-4d73-b061-d39126e36b31 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:57.084443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.085093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.086036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.086717 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.238684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cdb86bb8-b952-43c2-9a99-229f94bdf584 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.201622 Nov 24 17:51:57.239385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 74/152] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:57 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 17:51:57.244258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f6889718-f345-4d73-b061-d39126e36b31 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:57.246145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:57.246934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:57.252324 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f6889718-f345-4d73-b061-d39126e36b31 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1216 microversion: 2.1 time: 0.185521 Nov 24 17:51:57.261134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 79/153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:57 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:57.261694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.262211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.263067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.263570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.615997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:57.626277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7eb797e9-7c85-4194-b08f-0db2631f36af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.385400 Nov 24 17:51:57.632940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 75/154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:57 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:57.742322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:57.744587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:57.754785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.755325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.756308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.756894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.832339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] HTTP exception thrown: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. Nov 24 17:51:57.832913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Returning 404 to user: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:51:57.834084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-395a1120-72b7-49be-a69f-ee54dcdfc4fe tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 404 len: 111 microversion: 2.1 time: 0.096620 Nov 24 17:51:57.834951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 80/155] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 17:51:57 2021] DELETE /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:51:57.843929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:57.844534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] [instance: afc68395-e919-48bd-a6c4-cbd0819044b7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:57.852526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.853396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.854278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:57.854834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:57.911299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] HTTP exception thrown: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. Nov 24 17:51:57.912190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] Returning 404 to user: Instance afc68395-e919-48bd-a6c4-cbd0819044b7 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:51:57.913139 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-21740ab0-6f3c-4eec-a0ef-882854302788 tempest-DeleteServersTestJSON-1187974225 tempest-DeleteServersTestJSON-1187974225-project] 10.222.0.64 "GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7" status: 404 len: 111 microversion: 2.1 time: 0.072933 Nov 24 17:51:57.914153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 76/156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:57 2021] GET /compute/v2.1/servers/afc68395-e919-48bd-a6c4-cbd0819044b7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:51:58.252622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:58.253597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:58.262873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.263303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:58.264095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.264515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:58.273073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:58.273758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:58.285012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.286621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:58.287812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.288248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:58.377708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-18072dae-02e2-4e12-bb67-89a1663eadc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.128790 Nov 24 17:51:58.378363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 81/157] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:58 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:58.533680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:58.554221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cb8f19fc-7720-4ea6-8b0a-b4a323ee5261 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1268 microversion: 2.1 time: 0.284813 Nov 24 17:51:58.555502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 77/158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:58 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1268 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:51:58.645519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:58.646988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:58.657194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.658024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:58.659076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:58.659574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:59.061913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:59.077870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2a3f62af-2de8-4004-a7ce-2ccba92a2b3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.435740 Nov 24 17:51:59.078538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 82/159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:58 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:51:59.389155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:51:59.390654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:59.401954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:59.402934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:59.404898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:59.405654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:59.567373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-47b3ae9f-c02a-4f75-b8c8-13a369c1efde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.182172 Nov 24 17:51:59.568454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 78/160] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:51:59 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:51:59.572871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:51:59.574011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:51:59.590555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:59.591053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:59.591805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:51:59.592232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:51:59.816007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:51:59.828119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-eb627bcf-6744-4350-80ee-72781f756af9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1274 microversion: 2.1 time: 0.260202 Nov 24 17:51:59.829071 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 83/161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:51:59 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:00.095021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:00.095773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:00.103908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.104368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:00.105148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.105583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:00.584176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:00.586878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:00.596075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.596841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:00.598108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.598748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:00.704571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:00.717711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-22f51d59-9b51-49fd-a61b-ad5a6d5e0b8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.626770 Nov 24 17:52:00.718565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 79/162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:00 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:00.731557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c4e19513-74d7-4af8-ac55-23adfa21ceaa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.153807 Nov 24 17:52:00.732521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 84/163] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:00 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:52:00.845935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:00.846769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:00.866592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.867048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:00.867942 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:00.868405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:01.592292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:01.607493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a16222ec-e65e-4b75-b8d5-9792f51c06f1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.765181 Nov 24 17:52:01.608672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 80/164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:00 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:01.736891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:01.738063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:01.743991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:01.745179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:01.749453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:01.750707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:01.751959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:01.752783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:01.762857 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:01.763340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:01.764167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:01.764702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:01.932657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e59e1d74-1ce1-4e6b-af80-c16f24846cac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 14 microversion: 2.1 time: 0.193409 Nov 24 17:52:01.933627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 81/165] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:01 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:52:02.110919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:02.126898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-92897199-b043-4b21-8944-fa90952a87fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.393961 Nov 24 17:52:02.128728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 85/166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:01 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:02.531330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-26c5a8d3-6fea-4612-877a-085e62552a21 req-c39f2f59-2664-4431-8771-a3f0dbe511f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0e985a-631f-411c-a0ef-97f82f628918", "tag": "50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:02.532910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:02.532910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:52:02.565294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-26c5a8d3-6fea-4612-877a-085e62552a21 req-c39f2f59-2664-4431-8771-a3f0dbe511f9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:02.565744 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-26c5a8d3-6fea-4612-877a-085e62552a21 req-c39f2f59-2664-4431-8771-a3f0dbe511f9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:02.608855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-26c5a8d3-6fea-4612-877a-085e62552a21 req-c39f2f59-2664-4431-8771-a3f0dbe511f9 service nova] Creating event network-changed:50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a for instance ed0e985a-631f-411c-a0ef-97f82f628918 on hv-cinder-81857 Nov 24 17:52:02.619226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-26c5a8d3-6fea-4612-877a-085e62552a21 req-c39f2f59-2664-4431-8771-a3f0dbe511f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092474 Nov 24 17:52:02.625270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:02.625885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:02.636777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 82/167] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:02.639253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:02.640330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:02.642594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:02.645013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:03.067549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:03.082747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-df500ba3-bd1d-4386-a9ea-e13128aeaa5b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.458205 Nov 24 17:52:03.083351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 86/168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:02 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:03.090509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:03.095628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:03.108441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:03.109064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:03.110019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:03.110612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:03.227885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9846315f-9803-439d-9dfb-9b5d30facfea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 6451 microversion: 2.1 time: 0.142263 Nov 24 17:52:03.228516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 87/169] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:03 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:03.233574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:03.234434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:03.251508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:03.254363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cbeb1e69-b8e2-4952-8bd8-ea80985dcefa tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Action: 'create', calling method: .version_select at 0x7f8b114c3280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-709057252"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:03.258942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:03.259994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:03.260436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:03.772986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:03.782797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e6022846-4da1-4ef8-9fa2-22fa50df8aae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.552893 Nov 24 17:52:03.784893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 88/170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:03 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:04.099160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cbeb1e69-b8e2-4952-8bd8-ea80985dcefa tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.363887 Nov 24 17:52:04.100352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 83/171] 10.222.0.64 () {60 vars in 1154 bytes} [Wed Nov 24 17:52:02 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 1366 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 24 17:52:04.101544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:04.102762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:04.120107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9f1efa2f-5687-4b75-a00c-8f8ba9980297 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b705940>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:04.123353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.124568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.127032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.128424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.286512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9f1efa2f-5687-4b75-a00c-8f8ba9980297 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 200 len: 344 microversion: 2.1 time: 0.171520 Nov 24 17:52:04.287268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 84/172] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:04 2021] GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:04.293069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:04.294268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:04.308670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.310023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.311540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.312358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.513157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a0a6f385-a7da-4628-83cf-13aee1b575a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 15025 microversion: 2.1 time: 0.224199 Nov 24 17:52:04.514569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 85/173] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:04 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 15025 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:04.694889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:04.706051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e0b4458-b593-4a6b-9625-177e4edcaf28 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.610303 Nov 24 17:52:04.715986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 89/174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:04 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:04.803161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:04.804233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:04.813404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.814272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.815079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:04.815578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:04.920907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-905361832", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:05.009120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] validate_networks() for None {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:52:05.296228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:05.312373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-db2e71bf-3cdb-446e-a2b1-272eb1234150 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.512672 Nov 24 17:52:05.313217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 86/175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:04 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:05.324718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aedf11d4-00ba-42ab-8443-595716ba6d4a tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b7058b0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:05.371686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:52:05.372643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:52:05.373294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:52:05.373878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:52:05.374501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:52:05.383924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.388023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.389340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.389995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.410719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Getting quotas for project b283337774da482197ccccbdbb2a28b4. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:52:05.416130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Getting quotas for user e396bd4dc37e40e5b7c85b6e68b5d83c and project b283337774da482197ccccbdbb2a28b4. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:52:05.430424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:52:05.433328 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:52:05.447870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aedf11d4-00ba-42ab-8443-595716ba6d4a tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 200 len: 345 microversion: 2.1 time: 0.132941 Nov 24 17:52:05.448947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 87/176] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:05.462952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2c17f489-21a8-41aa-911f-557d0567d4b2 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Action: 'create', calling method: .version_select at 0x7f8b114c3280>, body: {"snapshot": {"volume_id": "89f66a3e-37d9-4a7e-a66f-82ce7b05ad42", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-888774986"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:05.513292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-681c9317-02f4-4d86-b2c3-09463a17303d tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596230 Nov 24 17:52:05.518702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 90/177] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:52:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:52:05.525342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d7de54c2-1051-4c13-909c-cc7aaf457195 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:05.525966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d7de54c2-1051-4c13-909c-cc7aaf457195 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:05.638553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7de54c2-1051-4c13-909c-cc7aaf457195 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:05.655828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d7de54c2-1051-4c13-909c-cc7aaf457195 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1214 microversion: 2.1 time: 0.135625 Nov 24 17:52:05.668074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 91/178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:05.674267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:05.675492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:05.685448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.685899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.686679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.687159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.817191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2c17f489-21a8-41aa-911f-557d0567d4b2 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.361258 Nov 24 17:52:05.818175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 88/179] 10.222.0.64 () {60 vars in 1161 bytes} [Wed Nov 24 17:52:05 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:05.823850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:05.824656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:05.830063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f71cefd6-ebe3-4446-946b-7f7ac2bda7ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 18155 microversion: 2.1 time: 0.160162 Nov 24 17:52:05.831135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 92/180] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:05 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 18155 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:05.837960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d11219f-911b-4541-9f92-09bac6d7c300 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b1005a790>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:05.852430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.852886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.853685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:05.854270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:05.914253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d11219f-911b-4541-9f92-09bac6d7c300 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 286 microversion: 2.1 time: 0.081669 Nov 24 17:52:05.914890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 93/181] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:05.924444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-feff18a3-74f5-4236-adbb-e4a89b20eda9 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0bf9de50>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:05.978244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-feff18a3-74f5-4236-adbb-e4a89b20eda9 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.057026 Nov 24 17:52:05.983815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 94/182] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:05.988849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-adf7ca40-15c4-4e42-9629-f14a7e258487 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0bf3f040>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:06.056191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-adf7ca40-15c4-4e42-9629-f14a7e258487 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 286 microversion: 2.1 time: 0.071012 Nov 24 17:52:06.056965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 95/183] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:06.156802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:06.168981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c230a6ed-e4e3-4c4c-a952-2fa2c8bf1673 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.349457 Nov 24 17:52:06.178780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 89/184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:05 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:06.333338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:06.334419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:06.348390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.349232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:06.350352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.351197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:06.674238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:06.676049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:06.677054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:06.686872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2fd99d46-c3f7-465e-97f4-a66c8d09a2c6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.357899 Nov 24 17:52:06.688656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.689335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:06.690872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.692060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:06.698100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 96/185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:06 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:06.824363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:06.832676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-02eda22b-36d9-4755-8c12-30e2606e116a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1218 microversion: 2.1 time: 0.162236 Nov 24 17:52:06.843130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 90/186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:06 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:06.843223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:06.844506 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:06.852369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.852809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:06.853769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:06.854363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.067955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ffc93572-c8f7-4444-9565-34b7310a1e4a tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b770670>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:07.115744 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ffc93572-c8f7-4444-9565-34b7310a1e4a tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 286 microversion: 2.1 time: 0.051398 Nov 24 17:52:07.116300 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 91/187] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:07 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:07.186810 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:07.187446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:07.195424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.196494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.197289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.197719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.480511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:07.489213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-88dac2e9-7ec1-4ade-8860-7f126955d7c0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.306237 Nov 24 17:52:07.489783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 92/188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:07 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:07.704759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:07.705360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:07.712677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.713122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.714116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.714548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.964220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:07.973762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bfc1316f-f529-4770-8571-ba1033f809d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.272501 Nov 24 17:52:07.974368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:07 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:07.979006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:07.979841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:07.987916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.988355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:07.989112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:07.989536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:08.130378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:08.139269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-78a330d9-1e44-4e09-ba87-77ffb1199889 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1218 microversion: 2.1 time: 0.163743 Nov 24 17:52:08.140326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 94/190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:07 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:08.145676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9c8b4792-64d0-4705-976b-c1200265dc11 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b705700>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:08.193808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9c8b4792-64d0-4705-976b-c1200265dc11 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 286 microversion: 2.1 time: 0.051811 Nov 24 17:52:08.194583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 95/191] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:08 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:08.506006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:08.506617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:08.514824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:08.515513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:08.516644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:08.517286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:08.799098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:08.807797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-177f9e66-f674-4cda-8d4f-deb4887f59e1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.305409 Nov 24 17:52:08.808356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 96/192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:08 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:08.946316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ae5c2e15-e7e3-45cc-b30b-917a08d7a889 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 23132 microversion: 2.1 time: 2.106479 Nov 24 17:52:08.950808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 97/193] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:06 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 23132 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:08.990533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:08.991241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:08.999336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:08.999817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.000795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.001229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.157507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:09.158838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:09.172741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.173485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.174595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.175498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.266423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:09.283639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a5cb5f5b-ec68-4453-8ae0-654c3b1e0c86 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.297122 Nov 24 17:52:09.286035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 97/194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:08 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:09.294793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7bc14b63-d2f2-4c17-9f83-1524a3a5faf6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b6e15e0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:09.358624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7bc14b63-d2f2-4c17-9f83-1524a3a5faf6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 287 microversion: 2.1 time: 0.067405 Nov 24 17:52:09.359721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 98/195] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:09 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:09.369985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e24a40b-b18b-42a2-bb54-7a8a1686c425 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b6e1430>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:09.402169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:09.438886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7387e266-7c0b-4c2d-a263-c5ac1255e126 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1266 microversion: 2.1 time: 0.285553 Nov 24 17:52:09.441159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 98/196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:09 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:09.547971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7e24a40b-b18b-42a2-bb54-7a8a1686c425 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 202 len: 0 microversion: 2.1 time: 0.181928 Nov 24 17:52:09.548635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 99/197] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Nov 24 17:52:09 2021] DELETE /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 17:52:09.560775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3359df62-0a75-4b3f-aae2-814dbe5e4ab8 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b100c9ee0>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:09.616630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3359df62-0a75-4b3f-aae2-814dbe5e4ab8 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 200 len: 286 microversion: 2.1 time: 0.063668 Nov 24 17:52:09.617230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 99/198] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:09 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:09.825409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:09.826167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:09.842601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.844140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.846027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.848696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.959827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:09.959827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:09.975325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.977414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:09.979384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:09.980928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:10.155885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-10b584be-a87b-470f-abd4-507dbd658721 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 24180 microversion: 2.1 time: 0.200056 Nov 24 17:52:10.157115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 100/199] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:09 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 24180 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:10.305072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:10.306086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:10.318847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:10.319399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:10.321208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:10.321485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:10.321936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:10.333067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-de064489-cd24-414b-8ea8-4c56a3b80505 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.511493 Nov 24 17:52:10.335590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 100/200] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:09 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:10.462164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:10.463031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:10.479382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:10.479873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:10.480702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:10.481155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:10.617821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:10.630398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6c874450-ab83-4b89-b7b8-7e2d8af5fc28 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1272 microversion: 2.1 time: 0.172415 Nov 24 17:52:10.635658 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 101/201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:10 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:10.640726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-582999e4-4a17-4021-8b53-eb4da6d26239 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b6e14c0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:10.673123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:10.690571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-78d00e06-ce3e-472d-ac01-956330d1fbeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.389612 Nov 24 17:52:10.701519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 101/202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:10 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:10.705641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-582999e4-4a17-4021-8b53-eb4da6d26239 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] HTTP exception thrown: Snapshot 1318048a-0325-4099-b84e-a89cfe7115ba could not be found. Nov 24 17:52:10.706273 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-582999e4-4a17-4021-8b53-eb4da6d26239 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Returning 404 to user: Snapshot 1318048a-0325-4099-b84e-a89cfe7115ba could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:10.707216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-582999e4-4a17-4021-8b53-eb4da6d26239 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba" status: 404 len: 111 microversion: 2.1 time: 0.074853 Nov 24 17:52:10.707985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 102/203] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 24 17:52:10 2021] GET /compute/v2.1/os-snapshots/1318048a-0325-4099-b84e-a89cfe7115ba => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:52:10.717837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8bad3381-b7b3-4601-8802-8c408064d9e2 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0beff0d0>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:10.857918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8bad3381-b7b3-4601-8802-8c408064d9e2 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 202 len: 0 microversion: 2.1 time: 0.144330 Nov 24 17:52:10.858670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 102/204] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 17:52:10 2021] DELETE /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:52:10.867763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4b49bd34-4ac1-493a-93b4-467ecd8910db tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b705940>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:10.984358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4b49bd34-4ac1-493a-93b4-467ecd8910db tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 200 len: 344 microversion: 2.1 time: 0.120864 Nov 24 17:52:10.985983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 103/205] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:10 2021] GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:11.170283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:11.171285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:11.186154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.200377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.201312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.203750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.298599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-a6ae2282-3cd2-4158-b706-d4c7b5755f52 req-80ec6887-a31b-4aaf-8eb1-4c921c4310fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0e985a-631f-411c-a0ef-97f82f628918", "name": "network-vif-plugged", "status": "completed", "tag": "50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:11.300267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:11.300267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:52:11.323201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a6ae2282-3cd2-4158-b706-d4c7b5755f52 req-80ec6887-a31b-4aaf-8eb1-4c921c4310fd service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.325968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a6ae2282-3cd2-4158-b706-d4c7b5755f52 req-80ec6887-a31b-4aaf-8eb1-4c921c4310fd service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.352322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-a6ae2282-3cd2-4158-b706-d4c7b5755f52 req-80ec6887-a31b-4aaf-8eb1-4c921c4310fd service nova] Creating event network-vif-plugged:50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a for instance ed0e985a-631f-411c-a0ef-97f82f628918 on hv-cinder-81857 Nov 24 17:52:11.357519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-a6ae2282-3cd2-4158-b706-d4c7b5755f52 req-80ec6887-a31b-4aaf-8eb1-4c921c4310fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062536 Nov 24 17:52:11.358628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 104/206] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:11.363929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:11.365281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:11.383434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.384204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.385154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.385591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.420181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-20b12b32-fee1-4a46-b6b5-f813d8a2932b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 25391 microversion: 2.1 time: 0.254611 Nov 24 17:52:11.420926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 103/207] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:11 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 25391 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:11.655813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:11.656658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:11.668154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.668762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.669670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:11.670239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:11.968315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:11.980629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c05899de-2993-4710-8887-57dcc71e17a1 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.330345 Nov 24 17:52:12.001476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 104/208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:11 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:12.005705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:12.006491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:12.014556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:12.014994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:12.015804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:12.016404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:12.198564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:12.214025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d5078a77-9cc7-483e-9f40-1beb8e43b578 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.853946 Nov 24 17:52:12.215178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 105/209] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:11 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:12.221085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8f2b93ca-37b5-4826-8766-a6c6dec88c91 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b6ecf70>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:12.297377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-8f2b93ca-37b5-4826-8766-a6c6dec88c91 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] HTTP exception thrown: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. Nov 24 17:52:12.298018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8f2b93ca-37b5-4826-8766-a6c6dec88c91 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Returning 404 to user: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:12.298841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8f2b93ca-37b5-4826-8766-a6c6dec88c91 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 404 len: 109 microversion: 2.1 time: 0.082511 Nov 24 17:52:12.299525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 106/210] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:12 2021] GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:52:12.309926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c92ad632-0abb-4a59-a331-dbd7e1abcc36 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b62bdc0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:12.380543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-c92ad632-0abb-4a59-a331-dbd7e1abcc36 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] HTTP exception thrown: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. Nov 24 17:52:12.381141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c92ad632-0abb-4a59-a331-dbd7e1abcc36 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Returning 404 to user: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:12.381959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c92ad632-0abb-4a59-a331-dbd7e1abcc36 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 404 len: 109 microversion: 2.1 time: 0.075932 Nov 24 17:52:12.382497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 107/211] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 17:52:12 2021] DELETE /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:52:12.393463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46d584f9-003c-4cd2-9829-5e908600d9c6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Calling method '.version_select at 0x7f8b0b6e1040>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:12.464260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-46d584f9-003c-4cd2-9829-5e908600d9c6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] HTTP exception thrown: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. Nov 24 17:52:12.465177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46d584f9-003c-4cd2-9829-5e908600d9c6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] Returning 404 to user: Volume 89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:12.466380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-46d584f9-003c-4cd2-9829-5e908600d9c6 tempest-VolumesSnapshotsTestJSON-138707772 tempest-VolumesSnapshotsTestJSON-138707772-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42" status: 404 len: 109 microversion: 2.1 time: 0.078587 Nov 24 17:52:12.467199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 108/212] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:12 2021] GET /compute/v2.1/os-volumes/89f66a3e-37d9-4a7e-a66f-82ce7b05ad42 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 17:52:12.472862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:12.480102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:12.481266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:12.490056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:12.490331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-666cbbdd-c8e2-41b8-b135-f9762097e5fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.485448 Nov 24 17:52:12.490951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 105/213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:12 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:12.496529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:12.498563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:12.499015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:12.639087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-10f10136-bf9e-43c5-a232-7043dfe2d56d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 26368 microversion: 2.1 time: 0.169139 Nov 24 17:52:12.639862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 109/214] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:12 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 26368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:12.999292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:13.003045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:13.026681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.027122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:13.027929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.028360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:13.235990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:13.238014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:13.247087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.247738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:13.248747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.249166 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:13.609533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:13.635069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5d6df180-fb85-43a1-a836-4d4979f2fb02 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.640536 Nov 24 17:52:13.636004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 106/215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:12 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:13.640862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:13.641464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:13.662052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.662489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:13.663474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:13.664893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.036238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:14.056347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6d5aa5c0-81e9-438f-b7ee-8872b34ce555 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1316 microversion: 2.1 time: 0.827121 Nov 24 17:52:14.057412 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 110/216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:13 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:14.072123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:14.073797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:14.082016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:14.082682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.083640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:14.084591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.144732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:14.176052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1aa405d0-2d03-4758-9ab1-f37ce5615f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.538957 Nov 24 17:52:14.180287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 107/217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:13 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:14.186577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-6aa26986-2d96-4768-99e1-06e7e3825b20 req-ad6c5161-58e1-4913-a492-aedc3e70fa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2784728-f018-45e5-ac01-9fb121333b35", "tag": "3c04d978-e9a4-4bda-ac5a-8e11afc81f83"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:14.198515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:14.198515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:14.217300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6aa26986-2d96-4768-99e1-06e7e3825b20 req-ad6c5161-58e1-4913-a492-aedc3e70fa00 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:14.217736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6aa26986-2d96-4768-99e1-06e7e3825b20 req-ad6c5161-58e1-4913-a492-aedc3e70fa00 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.247082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-6aa26986-2d96-4768-99e1-06e7e3825b20 req-ad6c5161-58e1-4913-a492-aedc3e70fa00 service nova] Creating event network-changed:3c04d978-e9a4-4bda-ac5a-8e11afc81f83 for instance f2784728-f018-45e5-ac01-9fb121333b35 on hv-cinder-81857 Nov 24 17:52:14.259485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-6aa26986-2d96-4768-99e1-06e7e3825b20 req-ad6c5161-58e1-4913-a492-aedc3e70fa00 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077677 Nov 24 17:52:14.261051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 108/218] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:14.483154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e81a14c0-197e-4625-8506-f1a129b025fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 27250 microversion: 2.1 time: 0.423880 Nov 24 17:52:14.484115 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 111/219] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:14 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 27250 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:14.658173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:14.659807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:14.669417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:14.670139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.671127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:14.671792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:14.999449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:15.014711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-01b907cc-9a56-4f8c-a52f-bd1f43f46b72 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.361206 Nov 24 17:52:15.015757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 109/220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:14 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:15.084517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:15.086956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:15.118022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.118530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.119479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.119939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.201862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:15.202788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:15.212070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.212513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.213330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.214109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.510703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:15.519220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0277c2a4-e8eb-436d-b1bb-c77581705701 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.326429 Nov 24 17:52:15.529373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 110/221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:15 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:15.537809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:15.562429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:15.572995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.573835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.574780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.575203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.704162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b83f08c1-036a-48c7-ac11-0f6c3b1a0e59 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 27536 microversion: 2.1 time: 0.173013 Nov 24 17:52:15.705517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 111/222] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:15 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 27536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:15.715746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:15.734956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-342ed3db-c234-475f-85da-439d9e0a9670 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1506 microversion: 2.1 time: 0.664175 Nov 24 17:52:15.736294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 112/223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:15 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1506 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:15.757480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202de15c-5965-47a6-b14b-252975f0a645"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:15.759379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:15.768901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.770122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.771288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:15.772085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:15.869545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6fb49949-e94a-4a6c-9c99-36717ef89d44 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Action: 'create', calling method: .version_select at 0x7f8b1005a5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-814057894", "metadata": {"Type": "work"}}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:15.952665 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Invalid volume: volume 202de15c-5965-47a6-b14b-252975f0a645 is already attached to instances: 93283903-e620-4b25-9d9b-dd8df929bc16 Nov 24 17:52:15.953501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 400 to user: Invalid volume: volume 202de15c-5965-47a6-b14b-252975f0a645 is already attached to instances: 93283903-e620-4b25-9d9b-dd8df929bc16 {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:15.954320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2632dd83-3a3b-46ed-971a-bb706055dd44 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.201165 Nov 24 17:52:15.955560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 113/224] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:52:15 2021] POST /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918/os-volume_attachments => generated 174 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 17:52:16.033897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:16.036298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:16.050552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.052639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.053956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.056402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.322789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:16.331453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-67ecb802-fa6b-4d41-844b-fa3ec8de6269 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.301849 Nov 24 17:52:16.332825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 114/225] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:16 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:16.347120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:16.347834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:16.356663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.357338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.358341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.358959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.391475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6fb49949-e94a-4a6c-9c99-36717ef89d44 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.684413 Nov 24 17:52:16.392227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 112/226] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Nov 24 17:52:15 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 24 17:52:16.403995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-15f95d33-4f67-441b-a29e-fdd49de41df7 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b10b911f0>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:16.512374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-15f95d33-4f67-441b-a29e-fdd49de41df7 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 200 len: 352 microversion: 2.1 time: 0.111905 Nov 24 17:52:16.513628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 113/227] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:16 2021] GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:16.527450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1412958255", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "13b3371c-40b3-489c-893f-79b52f800877"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:16.549985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lazy-loading 'services' on Instance uuid 93283903-e620-4b25-9d9b-dd8df929bc16 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:52:16.594002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] validate_networks() for [('13b3371c-40b3-489c-893f-79b52f800877', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:52:16.692580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-850f0428-c8f7-4f9d-baf0-396d460da752 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments/202de15c-5965-47a6-b14b-252975f0a645" status: 202 len: 0 microversion: 2.1 time: 0.358202 Nov 24 17:52:16.693402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 115/228] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:52:16 2021] DELETE /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments/202de15c-5965-47a6-b14b-252975f0a645 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:52:16.699022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:16.699968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:16.709542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.710092 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.711393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.711868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.945456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:16.954599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e69c0945-ee9e-424c-a8b6-34187eac6d4e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.259728 Nov 24 17:52:16.955162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 116/229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:16 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:16.969605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:16.973555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:16.981635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.982089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:16.982865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:16.983299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.050291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-30d728c0-ac18-4e26-917a-339769f0b491 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084400 Nov 24 17:52:17.053415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 117/230] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:52:16 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:17.057973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:17.059088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:17.067075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.067636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.068872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.069289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.168428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:52:17.168924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:52:17.169288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:52:17.169750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:52:17.170121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:52:17.183625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.184134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.184928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.185381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.204416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Getting quotas for project d38ff3a0728b4c08b344b804e0d1ccad. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:52:17.208702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dd5b1ffd-ec2f-4880-a68f-3b3d439808e5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28057 microversion: 2.1 time: 0.153547 Nov 24 17:52:17.208997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Getting quotas for user 35bf8078de0a44e3ad3f0ffa72306ef3 and project d38ff3a0728b4c08b344b804e0d1ccad. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:52:17.212531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 118/231] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:17 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28057 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:17.220779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:52:17.223216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:52:17.270068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5676c629-e38d-45d8-b3fc-43675b9ddcab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746797 Nov 24 17:52:17.276538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 114/232] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:52:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 17:52:17.283673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0749660c-de07-48bc-ac07-a38053340a10 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.284720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0749660c-de07-48bc-ac07-a38053340a10 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:17.352338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.353057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:17.364037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.364956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.366614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.371410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.409441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0749660c-de07-48bc-ac07-a38053340a10 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:17.419010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0749660c-de07-48bc-ac07-a38053340a10 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1219 microversion: 2.1 time: 0.139659 Nov 24 17:52:17.427721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 119/233] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:17.525888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ed3564e-9f93-46b9-a916-89f215fb2524 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b10042670>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.661908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ed3564e-9f93-46b9-a916-89f215fb2524 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 200 len: 353 microversion: 2.1 time: 0.140291 Nov 24 17:52:17.662479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 120/234] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:17.674970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6860cac6-064b-49d3-be2c-9d5640c3818d tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b101a2550>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.696033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:17.706755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1185890e-1a57-4236-81b3-9726f3e3614c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.360139 Nov 24 17:52:17.708594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 115/235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:17.778967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6860cac6-064b-49d3-be2c-9d5640c3818d tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 200 len: 353 microversion: 2.1 time: 0.108300 Nov 24 17:52:17.779541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 121/236] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:17.795683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cbba876f-3d2d-44ab-8717-feab2d468177 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b1005a940>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.903176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cbba876f-3d2d-44ab-8717-feab2d468177 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 202 len: 0 microversion: 2.1 time: 0.111448 Nov 24 17:52:17.907657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 116/237] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 17:52:17 2021] DELETE /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:52:17.912483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fabc8f1a-a004-4732-bb1f-72c21a8cf59d tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b10042e50>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.971923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:17.972461 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:17.986874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.987319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:17.988124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:17.988550 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.051457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fabc8f1a-a004-4732-bb1f-72c21a8cf59d tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 200 len: 352 microversion: 2.1 time: 0.143018 Nov 24 17:52:18.052104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 122/238] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:18.062905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:18.064068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:18.072998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.073788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.074689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.075137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.159030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-51330c5f-9ecb-462f-a63b-befc377d72bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100545 Nov 24 17:52:18.160198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 123/239] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:52:18 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 17:52:18.221434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:18.222870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:18.234074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.234520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.235405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.236078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.334476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:18.344273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c73e8b12-a418-4723-bda1-a2ff5acad0af tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.376104 Nov 24 17:52:18.345171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 117/240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:17 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:18.364311 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a72d9ce6-9ab6-4c81-84b5-d48868b53a78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28241 microversion: 2.1 time: 0.146352 Nov 24 17:52:18.364966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 124/241] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:18 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28241 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:18.429278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1415313128", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "d999ad69-34a5-4430-8f01-a48e3a42bfc5"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:18.440399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:18.441314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:18.457796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.458243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.459146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.459584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.534123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] validate_networks() for [('d999ad69-34a5-4430-8f01-a48e3a42bfc5', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:52:18.624840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:18.636403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a3832cd9-c490-43ca-9993-7dc03b2aa36b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1271 microversion: 2.1 time: 0.200932 Nov 24 17:52:18.636891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 125/242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:18 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:18.729675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:18.730843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:18.746310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.747721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:18.751541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:18.752431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.200186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:19.212042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0884f5c9-3660-4530-a8b4-6d306f0f4221 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.490051 Nov 24 17:52:19.213297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 126/243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:18 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:19.218327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c19aa1f-5e21-4535-b505-e74ae24290f5 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Calling method '.version_select at 0x7f8b101a2ee0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:19.313483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-3c19aa1f-5e21-4535-b505-e74ae24290f5 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] HTTP exception thrown: Volume 8aaff82a-b07d-405f-92e3-3c32d83c76fb could not be found. Nov 24 17:52:19.314324 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c19aa1f-5e21-4535-b505-e74ae24290f5 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] Returning 404 to user: Volume 8aaff82a-b07d-405f-92e3-3c32d83c76fb could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:19.315358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c19aa1f-5e21-4535-b505-e74ae24290f5 tempest-VolumesGetTestJSON-104244108 tempest-VolumesGetTestJSON-104244108-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb" status: 404 len: 109 microversion: 2.1 time: 0.100477 Nov 24 17:52:19.316119 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 127/244] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 17:52:19 2021] GET /compute/v2.1/os-volumes/8aaff82a-b07d-405f-92e3-3c32d83c76fb => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 17:52:19.365376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:19.366231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:19.388218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.388662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.392570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.393064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.411793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:52:19.412705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:52:19.414369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:52:19.415400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:52:19.416163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:52:19.447663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.450654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.452585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.453000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.517720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:52:19.534583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for user 6a81c70350ee4996b85c33ec8fedaa55 and project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:52:19.557377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:52:19.559869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:52:19.674672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5d851827-9487-48b9-b754-53739379a7c7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249357 Nov 24 17:52:19.681427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 118/245] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:52:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:52:19.698410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:19.699656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:19.708847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.709641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.711332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.712921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.915902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-577abb84-4903-4167-9e6c-05662d8a3852 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28241 microversion: 2.1 time: 0.232895 Nov 24 17:52:19.916873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 119/246] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:19 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28241 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:19.921926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:19.924912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:19.934751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.935505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.936564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:19.937188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:19.965316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:19.975904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8329b1c-09d0-4aa3-8f2d-52b451b63bcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.617378 Nov 24 17:52:19.996212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 128/247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:19 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:20.001047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fe3fc853-c5d8-4521-8c19-cecfb91680e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:20.001809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fe3fc853-c5d8-4521-8c19-cecfb91680e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:20.150940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fe3fc853-c5d8-4521-8c19-cecfb91680e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:20.168611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fe3fc853-c5d8-4521-8c19-cecfb91680e9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1218 microversion: 2.1 time: 0.170814 Nov 24 17:52:20.169086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 129/248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:19 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:20.228919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:20.229639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:20.238392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:20.238950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:20.240001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:20.240584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:20.480933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:20.491129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f4d7a0c6-4bdc-4e0e-8f05-d21e68fe2cb5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.572983 Nov 24 17:52:20.492561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 120/249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:19 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:20.668340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:20.681847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9c05f380-a0b0-41aa-9eeb-cefb37d64a24 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.457094 Nov 24 17:52:20.682352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 130/250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:20 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:20.932340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:20.933271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:20.941479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:20.941932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:20.942769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:20.943204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:20.999098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:21.000200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:21.016797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.028370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.029582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.030267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.106542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-678d0e46-6024-4957-9018-5dab31864c74 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28531 microversion: 2.1 time: 0.182085 Nov 24 17:52:21.111822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 121/251] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:20 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28531 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:21.188749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:21.189880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:21.215290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.216133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.217819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.218504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.402981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:21.415710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-54c96e74-711d-41a7-b8ff-4c21039812bf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1278 microversion: 2.1 time: 0.231152 Nov 24 17:52:21.417492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 122/252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:21 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:21.510518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:21.511644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:21.534131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.536266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.539138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.541565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.881240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:21.895587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8f9fba77-3f74-47af-abed-5e45067a23a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.390606 Nov 24 17:52:21.907333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 123/253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:21 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:21.907333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-caf091f6-deab-45ea-9bde-a0457baaf53b req-1de7de79-2e48-499d-a785-246636fb4fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2784728-f018-45e5-ac01-9fb121333b35", "name": "network-vif-plugged", "status": "completed", "tag": "3c04d978-e9a4-4bda-ac5a-8e11afc81f83"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:21.907333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:21.907333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:21.926730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-caf091f6-deab-45ea-9bde-a0457baaf53b req-1de7de79-2e48-499d-a785-246636fb4fcb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:21.927394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-caf091f6-deab-45ea-9bde-a0457baaf53b req-1de7de79-2e48-499d-a785-246636fb4fcb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:21.969583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-caf091f6-deab-45ea-9bde-a0457baaf53b req-1de7de79-2e48-499d-a785-246636fb4fcb service nova] Creating event network-vif-plugged:3c04d978-e9a4-4bda-ac5a-8e11afc81f83 for instance f2784728-f018-45e5-ac01-9fb121333b35 on hv-cinder-81857 Nov 24 17:52:21.974670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-caf091f6-deab-45ea-9bde-a0457baaf53b req-1de7de79-2e48-499d-a785-246636fb4fcb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076970 Nov 24 17:52:21.975470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 124/254] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:21.983993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:21.984780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:22.008933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.009797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.022101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.023663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.236649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:22.251014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5b0c92b9-0309-47c3-adfc-0a4d9f74649a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 1.261086 Nov 24 17:52:22.253415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 131/255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:20 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:22.268510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:22.270683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:22.281161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.282768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.284233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.284872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.406525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:22.424497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-704f8347-ae79-4dfa-9255-e4dd07561d81 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.445035 Nov 24 17:52:22.431427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ae01f0ef-ab69-4b5e-980e-5df6ef88b6c3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 0.175781 Nov 24 17:52:22.433161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 132/256] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:22 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:22.447411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 125/257] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:21 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:22.450863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:22.451571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:22.472263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.472633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.473419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.473848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.736828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:22.738965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-ca48878a-0d79-4305-b586-c8616e49778a req-ef03354f-288a-4561-923e-e2e73b4fb664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16db57ca-063c-485b-a4a7-4d92fcfbde5a", "tag": "10363e40-65d5-4242-9986-a18d5073f092"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:22.740565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:22.740565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:22.769339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-30db0e71-50ac-4852-857c-990c0f0f1232 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1276 microversion: 2.1 time: 0.333955 Nov 24 17:52:22.769926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 133/258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:22 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1276 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:22.781753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-ca48878a-0d79-4305-b586-c8616e49778a req-ef03354f-288a-4561-923e-e2e73b4fb664 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.782195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-ca48878a-0d79-4305-b586-c8616e49778a req-ef03354f-288a-4561-923e-e2e73b4fb664 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.803955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-ca48878a-0d79-4305-b586-c8616e49778a req-ef03354f-288a-4561-923e-e2e73b4fb664 service nova] Creating event network-changed:10363e40-65d5-4242-9986-a18d5073f092 for instance 16db57ca-063c-485b-a4a7-4d92fcfbde5a on hv-cinder-81857 Nov 24 17:52:22.812124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-ca48878a-0d79-4305-b586-c8616e49778a req-ef03354f-288a-4561-923e-e2e73b4fb664 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091927 Nov 24 17:52:22.813503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 126/259] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:22.915650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:22.916447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:22.927968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.928779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:22.930569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:22.931332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.270761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:23.271221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:23.279276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.279758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.280825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.281507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.631449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:23.641379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d4c8001-8789-4c74-be16-bd3bf3c5c770 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.374720 Nov 24 17:52:23.642176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 127/260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:23 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:23.648114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:23.649440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:23.657872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.658837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.659876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.660887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.736961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:23.754133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-25aa609a-4bec-40e1-897e-f8e6a752d926 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.841858 Nov 24 17:52:23.755063 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 134/261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:22 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:23.771544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:23.776412 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:23.788648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9a356e00-ea75-4391-b59f-d636296e096a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 0.144752 Nov 24 17:52:23.790166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 128/262] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:23 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:23.810348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.813763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:23.814480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:23.824170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.825835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.826463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.832825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.833316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:23.837490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:23.837962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:24.357413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:24.365663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0e10ef70-20f7-43fc-bd46-e1de404b854c tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1314 microversion: 2.1 time: 0.607538 Nov 24 17:52:24.367315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 135/263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:23 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:24.448581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:24.466688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d949f0b7-4334-45ef-8280-d46276b6e094 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.673841 Nov 24 17:52:24.467353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 129/264] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:23 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:24.657747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:24.658421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:24.669409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:24.669858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:24.670869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:24.671465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:24.771108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:24.771775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:24.780615 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:24.781055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:24.781826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:24.782433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.145247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:25.158949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2978a46f-5ce7-4fe1-8001-fb487a8ce75c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.392241 Nov 24 17:52:25.171195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 130/265] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:24 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:25.177422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:25.178776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:25.200419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:25.203411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.207303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.208274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.209098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.214918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-91aaa1b0-5017-4bd1-880f-01eb08a22d46 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.560192 Nov 24 17:52:25.222400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 136/266] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:24 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:25.390043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:25.391008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:25.400314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.401014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.403367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.404110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.432311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-62ed2209-c3ca-4172-8c8e-d292411df0ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 0.259179 Nov 24 17:52:25.433453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 131/267] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:25 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:25.484014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:25.484879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:25.501704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.502729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.504429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:25.506144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:25.846449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:25.855944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d83b22c-d5e4-4a1b-889d-38a72d89238a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.376229 Nov 24 17:52:25.858623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 132/268] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:25 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:26.093687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:26.102601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3d026442-764a-4d33-9d6b-b6760b9f2a1a tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1464 microversion: 2.1 time: 0.716919 Nov 24 17:52:26.103159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 137/269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:25 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1464 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:26.173583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:26.174599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.176709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:26.177438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.182545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.183001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.183805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.184235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.185480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.186157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.187179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.187768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.251483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 17:52:26.389410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-90aab2d2-5997-48cb-9355-bc9333f23834 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 204 len: 0 microversion: 2.1 time: 0.216990 Nov 24 17:52:26.390181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 133/270] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 17:52:26 2021] DELETE /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 17:52:26.397522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:26.398784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.406543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.406992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.408274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.408723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.433861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:26.448266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c3f97532-9503-4f0f-8627-c8313cbfc604 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.275262 Nov 24 17:52:26.449424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 138/271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:26 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:26.454295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-6ab9427b-c21b-4c72-b2cc-f47402e1bac1 req-394a1a68-054e-42d2-8b7c-6d5f8a47d6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a262d0fc-9809-4030-b5f5-3f7d25323e4b", "tag": "8fa8ced4-236c-4411-8064-df63a3451657"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:26.456053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:26.456053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:52:26.466481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-6ab9427b-c21b-4c72-b2cc-f47402e1bac1 req-394a1a68-054e-42d2-8b7c-6d5f8a47d6b1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.467551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-6ab9427b-c21b-4c72-b2cc-f47402e1bac1 req-394a1a68-054e-42d2-8b7c-6d5f8a47d6b1 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.486386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-6ab9427b-c21b-4c72-b2cc-f47402e1bac1 req-394a1a68-054e-42d2-8b7c-6d5f8a47d6b1 service nova] Creating event network-changed:8fa8ced4-236c-4411-8064-df63a3451657 for instance a262d0fc-9809-4030-b5f5-3f7d25323e4b on hv-cinder-81857 Nov 24 17:52:26.492758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-6ab9427b-c21b-4c72-b2cc-f47402e1bac1 req-394a1a68-054e-42d2-8b7c-6d5f8a47d6b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041249 Nov 24 17:52:26.494057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 139/272] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:26.502878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:26.503822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.513495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.514456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.515397 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.516141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.644541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:26.653735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-041f6aed-e05d-4e17-aa0a-b9a4e5f4f22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.260968 Nov 24 17:52:26.654858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 134/273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:26 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:26.659576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:26.660589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.669145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.669912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.670789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.671410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.735142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:26.746175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-69f20ca9-8355-4ea8-bc9a-946617be04bc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1470 microversion: 2.1 time: 0.246246 Nov 24 17:52:26.746175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 140/274] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:26 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:26.874153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:26.874878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:26.882655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.883276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:26.884089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:26.884522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.102950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:27.110997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e7e9a2ab-62b6-4f44-a5f7-deb15cccc762 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.242153 Nov 24 17:52:27.111559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 141/275] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:26 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:27.465932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:27.466578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:27.473684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.474202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.475026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.475515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.688490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:27.697610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0fc12e6b-a7c2-4c7b-8dec-4c711008097e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.235159 Nov 24 17:52:27.698170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 142/276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:27 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:27.702805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:27.703411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:27.710750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.711205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.712019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.712458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.912332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:27.921447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d773c3ee-5fb7-41f6-b359-70d362865db3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.222136 Nov 24 17:52:27.922147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 143/277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:27 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:27.926516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:27.927124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:27.935072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.935517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:27.936342 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:27.936779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.152256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:28.160569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9c0c70d2-e09a-4ab8-aa5a-def83805b737 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1470 microversion: 2.1 time: 0.237433 Nov 24 17:52:28.161140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 144/278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:27 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:28.166093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:28.167117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:28.174770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.175218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.176021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.176460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.377736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:28.387007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6bd7574b-1e9e-49e3-b081-9c75144ec807 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.224885 Nov 24 17:52:28.387810 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 145/279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:28 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:28.722345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:28.725376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:28.744759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.746896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.748101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.748669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.786418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e64474f6-c726-449d-91ec-683abab3173d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 2.130175 Nov 24 17:52:28.788104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 135/280] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:26 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:28.941960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:28.942761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:28.963323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.963821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:28.967527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:28.968030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.219861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:29.230190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3b81a1da-b36e-4dea-9058-98d5b099762c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.515800 Nov 24 17:52:29.241449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 146/281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:28 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:29.257361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:29.258232 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:29.266479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.266841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.267637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.268062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.679819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:29.689721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bb594370-aa1e-4f2c-a47d-63988a9c0cdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.753940 Nov 24 17:52:29.704482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 136/282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:28 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:29.714074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:29.716545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:29.717354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:29.723853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-580bbe33-30ea-4d3b-aa7d-835102081ffd tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1470 microversion: 2.1 time: 0.480176 Nov 24 17:52:29.727986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 147/283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:29 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:29.731415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.732001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.732659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.733089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.799162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:29.800606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:29.812509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.816131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:29.817449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:29.820939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.013632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-39e7bf9f-c7a2-4093-95b4-9be1c4689820 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 0.218423 Nov 24 17:52:30.018374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 148/284] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:29 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:30.085776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:30.096033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d1eb9b44-ae04-44cd-be72-642565fa5a29 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.389945 Nov 24 17:52:30.097489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 137/285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:29 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:30.248497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:30.249206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:30.259020 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.259475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.260325 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.260762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.609049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:30.620444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e8fe8616-d8a0-419d-9f28-04029d984cdd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.376198 Nov 24 17:52:30.621293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 149/286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:30 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:30.712253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:30.713016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:30.720827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.721361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.722345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.722781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.743417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:30.745175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:30.752619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.753384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.754267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:30.754793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:30.964730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:30.972964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0ff6af5a-9b3d-4336-aab2-012650c24b68 tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1470 microversion: 2.1 time: 0.234949 Nov 24 17:52:30.973657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 150/287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:30 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:31.025869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:31.026789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:31.035094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.035809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.036754 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.037340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.056778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:31.083621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e596eea8-75e7-4119-9e16-c1ecee551954 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1522 microversion: 2.1 time: 0.376309 Nov 24 17:52:31.087270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 138/288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:30 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:31.115054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:31.117098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:31.133873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.134317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.135085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.135905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.217695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5f6ba453-0cee-4bdd-96ff-add924c0a38f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 28699 microversion: 2.1 time: 0.195965 Nov 24 17:52:31.218341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 151/289] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:31 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 28699 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:31.354889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:31.364065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-08e3d169-9c0c-4ace-b11f-20749e86a405 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.253663 Nov 24 17:52:31.364813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 139/290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:31 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:31.637122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:31.637899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:31.645891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.646338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.647112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:31.647523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:31.973759 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-05d258bf-c8cd-4586-bf5e-5130f77e1f5b req-3343ea68-fd3c-4814-8b9e-d0f4e2b8c630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16db57ca-063c-485b-a4a7-4d92fcfbde5a", "name": "network-vif-plugged", "status": "completed", "tag": "10363e40-65d5-4242-9986-a18d5073f092"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:31.975495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:31.975495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:31.999697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-05d258bf-c8cd-4586-bf5e-5130f77e1f5b req-3343ea68-fd3c-4814-8b9e-d0f4e2b8c630 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.000302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-05d258bf-c8cd-4586-bf5e-5130f77e1f5b req-3343ea68-fd3c-4814-8b9e-d0f4e2b8c630 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.038008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-05d258bf-c8cd-4586-bf5e-5130f77e1f5b req-3343ea68-fd3c-4814-8b9e-d0f4e2b8c630 service nova] Creating event network-vif-plugged:10363e40-65d5-4242-9986-a18d5073f092 for instance 16db57ca-063c-485b-a4a7-4d92fcfbde5a on hv-cinder-81857 Nov 24 17:52:32.051998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-05d258bf-c8cd-4586-bf5e-5130f77e1f5b req-3343ea68-fd3c-4814-8b9e-d0f4e2b8c630 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092911 Nov 24 17:52:32.053372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 140/291] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:32.062043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:32.062977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:32.093590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.094185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.094816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.095267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.184871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:32.192952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90059fb4-1023-418c-8302-58642ed09b1f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.559862 Nov 24 17:52:32.193555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 152/292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:31 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:32.198264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:32.198864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:32.215332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.216208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.217221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.217728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.443436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:32.456591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7fe4b0b8-9c59-4442-b938-456ad6034bae tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1470 microversion: 2.1 time: 0.400159 Nov 24 17:52:32.458906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 141/293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:32 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1470 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:32.467324 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:32.470199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:32.478593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.479233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.480232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.480816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.805456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:32.817973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ac4008bd-1fd3-42f4-a375-a2c163b51a41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1502 microversion: 2.1 time: 0.623090 Nov 24 17:52:32.818914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 153/294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:32 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1502 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:32.831414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:32.834972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:32.844673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.845629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.846970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.847405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.863847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a463065e-5988-469e-85d9-24564bbb45ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 29492 microversion: 2.1 time: 0.399752 Nov 24 17:52:32.866006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 142/295] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:32 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 29492 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:32.873020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-f47ace6b-aa5b-4b72-98b4-8ca1579c975c req-e48eba56-070d-46a1-a87d-f4f4672330c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2784728-f018-45e5-ac01-9fb121333b35", "name": "network-vif-deleted", "tag": "3c04d978-e9a4-4bda-ac5a-8e11afc81f83"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:32.875791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:32.875791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:32.887088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-f47ace6b-aa5b-4b72-98b4-8ca1579c975c req-e48eba56-070d-46a1-a87d-f4f4672330c4 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.887817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-f47ace6b-aa5b-4b72-98b4-8ca1579c975c req-e48eba56-070d-46a1-a87d-f4f4672330c4 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.907650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-f47ace6b-aa5b-4b72-98b4-8ca1579c975c req-e48eba56-070d-46a1-a87d-f4f4672330c4 service nova] Creating event network-vif-deleted:3c04d978-e9a4-4bda-ac5a-8e11afc81f83 for instance f2784728-f018-45e5-ac01-9fb121333b35 on hv-cinder-81857 Nov 24 17:52:32.913872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-f47ace6b-aa5b-4b72-98b4-8ca1579c975c req-e48eba56-070d-46a1-a87d-f4f4672330c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044698 Nov 24 17:52:32.915251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 143/296] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:32.921761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:32.924348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:32.934737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.935524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:32.936738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:32.937327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.093610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:33.103284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-71d73598-ca2d-4d45-8a8d-4b0eaf6bdaea tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.282937 Nov 24 17:52:33.103948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 154/297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:32 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:33.210602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:33.211411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:33.218648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.219103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.219986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.220433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.243987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:33.270555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f8e67b6b-db00-4923-998d-4495e9809b41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1516 microversion: 2.1 time: 0.353912 Nov 24 17:52:33.274026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 144/298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:33.474568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:33.475441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:33.488574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.489266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.490653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.491086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.495149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:33.511287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-943475ce-a530-4884-8333-d4ac07cf25e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1319 microversion: 2.1 time: 0.304780 Nov 24 17:52:33.517123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 155/299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:33 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:33.582484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.582872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.583429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lazy-loading 'fault' on Instance uuid f2784728-f018-45e5-ac01-9fb121333b35 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:52:33.648147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e396bd4dc37e40e5b7c85b6e68b5d83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b283337774da482197ccccbdbb2a28b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:33.657019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8ed73157-f90f-4716-849a-a8a6867c413f tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 200 len: 1304 microversion: 2.1 time: 0.186556 Nov 24 17:52:33.658414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 145/300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:33 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:33.878096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:33.879270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:33.887816 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.888421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:33.889396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:33.889982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.047383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1904b8c8-fb1d-4b4c-8842-17708d6f47b3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 30548 microversion: 2.1 time: 0.171445 Nov 24 17:52:34.047383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 156/301] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:33 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 30548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:34.123321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:34.124188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:34.142300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.142754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.143538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.148684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.534650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:34.538176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:34.546256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:34.555743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3665f83d-40d1-4fba-a600-42ead4b2183e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.438354 Nov 24 17:52:34.561914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.563023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 146/302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:34 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:34.563672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.564608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.565197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.675165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:34.677874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] [instance: f2784728-f018-45e5-ac01-9fb121333b35] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:34.687224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.688213 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.689241 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.690049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.749972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] HTTP exception thrown: Instance f2784728-f018-45e5-ac01-9fb121333b35 could not be found. Nov 24 17:52:34.750579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] Returning 404 to user: Instance f2784728-f018-45e5-ac01-9fb121333b35 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:52:34.751394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-82ec2f03-92a0-4742-b829-55c73e1ef5cc tempest-VolumesNegativeTest-1853627152 tempest-VolumesNegativeTest-1853627152-project] 10.222.0.64 "GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35" status: 404 len: 111 microversion: 2.1 time: 0.079986 Nov 24 17:52:34.752177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 147/303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:34 2021] GET /compute/v2.1/servers/f2784728-f018-45e5-ac01-9fb121333b35 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 17:52:34.896426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:34.908036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a61e1596-2bea-4953-a6ec-6c95909c2bb2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1508 microversion: 2.1 time: 0.377251 Nov 24 17:52:34.908713 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 157/304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:34 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:34.975204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:34.976402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:34.985439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.986025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:34.986896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:34.987426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.058152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:35.059394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:35.068430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.071125 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.072392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.073773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.079099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lazy-loading 'flavor' on Instance uuid d195ce54-bd42-4deb-b7de-c80fcfcd3437 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:52:35.284387 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-517043d7-57cd-4d10-a3c7-3549bd25fbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action" status: 200 len: 32 microversion: 2.1 time: 0.315911 Nov 24 17:52:35.285299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 148/305] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:34 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action => generated 32 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:52:35.296297 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:35.296988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:35.306526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.307009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.307974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.308680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.737676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:35.748004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-02ea376b-c90e-43ce-b8a2-3d7ecb1f865c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.456437 Nov 24 17:52:35.748831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 149/306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:35.764149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:35.764748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:35.772184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.772662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:35.773562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:35.773993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:36.112356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:36.122091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cdcd5d8d-5376-460c-9908-d50fa073c2ac tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.361387 Nov 24 17:52:36.122912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 150/307] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:35 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:36.765037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:36.765638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:36.776704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:36.777181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:36.777918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:36.778363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:37.044038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:37.056024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ac0f2602-8470-40a9-a3fb-9ca5feca44c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.294066 Nov 24 17:52:37.057296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 151/308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:37.141129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:37.141983 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:37.154185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:37.155186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:37.156451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:37.156978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:37.482876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:37.494257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9c481e0e-4c24-46ae-8d42-cb2a235380ba tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 32601 microversion: 2.1 time: 2.440397 Nov 24 17:52:37.496908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 158/309] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:35 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 32601 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:37.503151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-50172559-31b0-454a-b2b0-5b1d1c9d26f6 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.367387 Nov 24 17:52:37.503776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 152/310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:37 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:38.081845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:38.082535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:38.131147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.131635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:38.132977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.133389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:38.508849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:38.509784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:38.523751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.524155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:38.525056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.525493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:38.671197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-258aa8a7-7cef-4c90-a64b-318e6460f785 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 33759 microversion: 2.1 time: 0.167163 Nov 24 17:52:38.672130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 153/311] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:38 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 33759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:38.693811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:38.695142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:38.719920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.721301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:38.724054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:38.725223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:39.164768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:39.175363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:39.176432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6a85a762-37de-45cf-8dfb-efa951c12586 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 1.099305 Nov 24 17:52:39.177765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 159/312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:39.192006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f8beeb5c-3639-4362-8551-4c5fd6f8eeda tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.518431 Nov 24 17:52:39.193086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 154/313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:38 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:39.686146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:39.687503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:39.696676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:39.697386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:39.698299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:39.698977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:40.194264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:40.195532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:40.206575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:40.207023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:40.209202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:40.210887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:40.489188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:40.501848 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7960eac4-7fa2-4522-abad-82f62153eff4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.311485 Nov 24 17:52:40.503007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 155/314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:40.520959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:40.524137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:40.532735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:40.533438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:40.547582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:40.548217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:40.838266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:40.857084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a5124539-c4bd-409a-a186-5bfd911f2718 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.352781 Nov 24 17:52:40.857951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 156/315] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:40 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:40.979871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-6b633e47-c084-49c7-872a-9215f39d97d3 req-c68c19a1-1008-4a75-bae9-aecbfd81c511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a262d0fc-9809-4030-b5f5-3f7d25323e4b", "name": "network-vif-plugged", "status": "completed", "tag": "8fa8ced4-236c-4411-8064-df63a3451657"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:40.981433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:52:40.981433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:52:40.993026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6b633e47-c084-49c7-872a-9215f39d97d3 req-c68c19a1-1008-4a75-bae9-aecbfd81c511 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:40.993464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6b633e47-c084-49c7-872a-9215f39d97d3 req-c68c19a1-1008-4a75-bae9-aecbfd81c511 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:41.040099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-6b633e47-c084-49c7-872a-9215f39d97d3 req-c68c19a1-1008-4a75-bae9-aecbfd81c511 service nova] Creating event network-vif-plugged:8fa8ced4-236c-4411-8064-df63a3451657 for instance a262d0fc-9809-4030-b5f5-3f7d25323e4b on hv-cinder-81857 Nov 24 17:52:41.058322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-6b633e47-c084-49c7-872a-9215f39d97d3 req-c68c19a1-1008-4a75-bae9-aecbfd81c511 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083291 Nov 24 17:52:41.059483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 157/316] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:52:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:41.521043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:41.522941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:41.531302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:41.531947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:41.532914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:41.533545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:41.803994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:41.814400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0800fa14-f1b4-4d2d-aa85-c8c28b17dd02 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.297433 Nov 24 17:52:41.815004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 158/317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:41.874530 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:41.875495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:41.888439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:41.889568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:41.897187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:41.898278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:42.320643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:42.329171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d01b30a-8001-45a0-bbe2-95f77e11b2f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.458786 Nov 24 17:52:42.329871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 159/318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:41 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:42.677953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-32afedc6-43cf-462e-b30e-3857a5e862c5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 36634 microversion: 2.1 time: 2.998774 Nov 24 17:52:42.679765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 160/319] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:39 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 36634 bytes in 3002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:42.833708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:42.836366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:42.856765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:42.859343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:42.860625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:42.861851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:43.150560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:43.162337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-07cca337-906d-4ef3-ac99-fc73529d6c6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.333058 Nov 24 17:52:43.163643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 160/320] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:43.354721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:43.355424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:43.373823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:43.374294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:43.375171 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:43.375618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:43.693856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:43.695540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:43.711114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:43.715201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:43.716431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:43.717015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:43.862927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:43.876533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4008002e-d148-4648-88c3-677fea65e4ae tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.532827 Nov 24 17:52:43.880033 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 161/321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:43 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:43.891084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d9559fab-17c9-4ebb-bff8-2b94f5b4d1ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 37547 microversion: 2.1 time: 0.204432 Nov 24 17:52:43.891838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 161/322] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:43 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 37547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:44.180801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:44.181660 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:44.189483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.190090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:44.191039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.196006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:44.499242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:44.509330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d145fb77-4016-4f2b-985f-9e0c2fc99c3a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.333020 Nov 24 17:52:44.524005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 162/323] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:44.896558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:44.898251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:44.902987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:44.903903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:44.906894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.907703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:44.908641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.909375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:44.911481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.911960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:44.912740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:44.913227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:45.317987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:45.328672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aeb0512d-81e6-433a-9299-b77b7ab3386e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.436213 Nov 24 17:52:45.329240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 162/324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:44 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:45.527566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:45.528271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:45.536498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:45.536498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:45.537115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:45.537537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:45.832063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:45.841587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26e1d42a-ae8a-49b2-aed8-985ba3c3a0a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.318194 Nov 24 17:52:45.842157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 163/325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:46.346542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:46.347532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:46.357337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:46.358184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:46.358971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:46.359576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:46.853983 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:46.862522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0746503e-ef91-40b6-b7a5-455f36ec26ca tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.520026 Nov 24 17:52:46.873658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 164/326] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:46 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:46.878774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:46.879635 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:46.887672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:46.888349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:46.889369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:46.889947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:47.237466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:47.260832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3552aff9-725c-47a3-954f-c7d0b72d1abb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.385654 Nov 24 17:52:47.268630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 165/327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:47.880167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:47.880824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:47.889642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:47.890091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:47.891180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:47.893087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:48.130193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9db119d8-d788-4109-87e9-95477236aa2d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 38193 microversion: 2.1 time: 3.230488 Nov 24 17:52:48.136525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 163/328] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:44 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 38193 bytes in 3238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 17:52:48.286603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:48.288900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:48.302001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:48.302657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:48.303496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:48.303960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:48.499298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:48.513515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9303a8dc-3537-4984-a56d-3d5010428b4a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1318 microversion: 2.1 time: 0.637280 Nov 24 17:52:48.519696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 166/329] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:47 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:52:48.760815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:48.772855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b438e6cc-496c-4133-abfd-2d5706c9b285 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.489730 Nov 24 17:52:48.774517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 164/330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:49.143640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:49.144839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:49.158469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.159287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:49.160295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.160926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:49.289917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a3bd5025-9ceb-4fb9-915f-c86a2b5f5197 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 38193 microversion: 2.1 time: 0.148394 Nov 24 17:52:49.291833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 167/331] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:49 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 38193 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:49.540712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:49.542316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:49.579819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.580526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:49.587641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.588272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:49.799145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:49.800088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:49.826395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.827549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:49.828630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:49.829619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:50.275055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:50.290356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-772c7606-5637-4a08-a891-72c385546054 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.498942 Nov 24 17:52:50.292756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 168/332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:50.307693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:50.308613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:50.331249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:50.331737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:50.332517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:50.334112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:50.372156 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:50.384137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aa344960-9711-4bf5-a3d6-635b7c366731 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1508 microversion: 2.1 time: 0.852160 Nov 24 17:52:50.387994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 165/333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:49 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1508 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:50.558454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-98fc7069-2736-4c58-a765-3bfd232a7186 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 38319 microversion: 2.1 time: 0.254700 Nov 24 17:52:50.565620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 169/334] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:52:50 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 38319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 17:52:50.570830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:50.571941 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:50.593284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:50.593736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:50.594529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:50.594961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:50.711279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-642e6f2c-82ca-43ff-8992-5f5c72619446 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/ips" status: 200 len: 144 microversion: 2.1 time: 0.144743 Nov 24 17:52:50.717650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 166/335] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 17:52:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/ips => generated 144 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:51.310991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:51.312974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:51.329229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:51.332539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:51.334062 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:51.335396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:51.666066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:51.675174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d784baa-858f-42e4-8066-ee6438ca9faf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.369645 Nov 24 17:52:51.683638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 170/336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:52.377478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7522b507-061a-4502-a9df-e576f72351e1"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:52.378681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:52.386812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:52.387378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:52.394921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:52.395522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:52.695478 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:52.702327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:52.724294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:52.725165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:52.727468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:52.728088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:53.154336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:53.177805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b124b60b-111d-4657-9910-f6dfc4cd2fab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.487224 Nov 24 17:52:53.189875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 171/337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:53.255406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cecb10ed-535d-458c-900d-8db8655878d0 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881649 Nov 24 17:52:53.261990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 167/338] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:52:52 2021] POST /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:52:54.196037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:54.196646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:54.204292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:54.204963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:54.205915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:54.206413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:54.427800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "158bd37a-bb86-4728-8b2d-b7bca6c98d5c"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:52:54.430235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:54.455058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:54.457072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:54.460552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:54.464653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:54.465227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:54.467888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1cf87b72-996d-4a67-b9de-108dfb3ab3d5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.275760 Nov 24 17:52:54.468936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 172/339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:54.909505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-63d8ce20-c6fb-43a5-ba9b-f53cd8376ee4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489079 Nov 24 17:52:54.910218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 168/340] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:52:54 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:52:55.485673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:55.486278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:55.495975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:55.496831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:55.497197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:55.497634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:55.708648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:55.718749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ba98e2fd-8b00-48fb-b234-276791da81ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.236651 Nov 24 17:52:55.719546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 173/341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:56.738175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:56.739407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:56.749303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:56.751527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:56.752424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:56.760967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:57.012294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:57.023339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-03dd6304-cc17-402c-83aa-b15e21f07c08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.289981 Nov 24 17:52:57.032863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 169/342] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:58.040416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:58.041778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:58.051155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:58.051628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:58.052639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:58.053866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:58.265247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:58.274330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-65064dc5-37db-4fbd-a31c-b261faec9806 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.237645 Nov 24 17:52:58.283863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 174/343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:52:59.293670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:52:59.294372 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:52:59.302334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:59.302775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:59.304384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:52:59.304830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:52:59.522879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:52:59.530960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-177e0515-77dd-4b40-b905-042eebb30998 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.241435 Nov 24 17:52:59.531510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 170/344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:52:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:00.549734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:00.550312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:00.559125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:00.559560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:00.560344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:00.560868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:00.790293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:00.798547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-754887e7-26c3-448e-9f68-c36edbee474d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.253306 Nov 24 17:53:00.799102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 175/345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:01.300682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7522b507-061a-4502-a9df-e576f72351e1"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:01.301728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:01.309485 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.309931 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.310688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.311119 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.479768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Invalid volume: volume 7522b507-061a-4502-a9df-e576f72351e1 is already attached to instances: a262d0fc-9809-4030-b5f5-3f7d25323e4b Nov 24 17:53:01.480373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 400 to user: Invalid volume: volume 7522b507-061a-4502-a9df-e576f72351e1 is already attached to instances: a262d0fc-9809-4030-b5f5-3f7d25323e4b {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:53:01.481195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-36d5fdb8-6c4b-4c3b-80df-fbc570c45ff5 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.184408 Nov 24 17:53:01.481760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 171/346] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:53:01 2021] POST /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 174 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 17:53:01.587571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:01.588138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:01.595795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.596242 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.597020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.597450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.757179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lazy-loading 'services' on Instance uuid a262d0fc-9809-4030-b5f5-3f7d25323e4b {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:53:01.815834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:01.816363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:01.825995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.826943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.827884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.828323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.915486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6cf5ec6c-d535-40ff-a247-01440416dbb1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments/7522b507-061a-4502-a9df-e576f72351e1" status: 202 len: 0 microversion: 2.1 time: 0.331974 Nov 24 17:53:01.916107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 176/347] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:53:01 2021] DELETE /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments/7522b507-061a-4502-a9df-e576f72351e1 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:53:01.924907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:01.926552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:01.934547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.934993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:01.936301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:01.936742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:02.007429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a52282bb-d938-4f14-9eaf-9e7f7c62ab99 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086563 Nov 24 17:53:02.011804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 177/348] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:01 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:53:02.043150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:02.056388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-77c46aff-355e-42f2-8c95-513308b323f4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.244007 Nov 24 17:53:02.057058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 172/349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:03.019232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:03.020164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:03.027867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:03.028310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:03.029075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:03.029504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:03.075041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:03.075674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:03.083878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:03.084507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:03.085444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:03.085885 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:03.095282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-02a85d35-81e0-4a1d-8bf1-23a9a7c104aa tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079768 Nov 24 17:53:03.096052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 178/350] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:03 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:03.290574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:03.299363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fccbc758-6dab-4ed9-a32d-e5a0502e97a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.228121 Nov 24 17:53:03.299948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 173/351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:04.106984 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:04.108516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:04.116251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:04.116904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:04.117684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:04.118109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:04.186082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b807ba62-c89a-4a15-a2d8-fef8f40ea06c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082876 Nov 24 17:53:04.190409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 179/352] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:04 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:04.317014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:04.317632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:04.327795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:04.328256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:04.329047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:04.329481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:04.569212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:04.580024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-866de5d6-6fca-4f24-a9a9-b24bff947bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.266860 Nov 24 17:53:04.580593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 174/353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:05.207941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:05.209715 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:05.220775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:05.221496 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:05.222927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:05.223710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:05.302293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-af3ce788-c00e-4cc3-abcc-423af7ef8c63 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107850 Nov 24 17:53:05.307150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 180/354] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:05 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:05.598146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:05.598898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:05.607390 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:05.607882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:05.608688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:05.609129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:05.870865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:05.911203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-54994af5-f74e-4c8f-821f-6ecb31898759 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.316807 Nov 24 17:53:05.922544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 175/355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:06.314961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:06.315918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:06.324150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:06.324595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:06.325379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:06.325814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:06.426949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-597b19b6-7520-4efa-b205-770db0185495 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115710 Nov 24 17:53:06.428841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 181/356] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:06 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:06.929322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:06.932028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:06.940901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:06.941602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:06.942538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:06.943296 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:07.296677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:07.307352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-35d379b9-dd81-4cfb-98b0-81a1c4c336b1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.382296 Nov 24 17:53:07.309569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 176/357] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:07.440425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:07.442028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:07.459851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:07.460562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:07.462177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:07.463148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:07.566845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aeffabb9-17a7-408b-af48-6519ac5aee6e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130769 Nov 24 17:53:07.568049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 182/358] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:07 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:08.324234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:08.325602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:08.333353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.334989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.336091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.336741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.445473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6c0c2a71-0a86-4f64-a66b-51867e40976c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:08.460329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c0c2a71-0a86-4f64-a66b-51867e40976c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.461173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c0c2a71-0a86-4f64-a66b-51867e40976c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.534719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6c0c2a71-0a86-4f64-a66b-51867e40976c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Going to try to stop instance {{(pid=100949) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Nov 24 17:53:08.654639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6c0c2a71-0a86-4f64-a66b-51867e40976c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 202 len: 0 microversion: 2.1 time: 0.213280 Nov 24 17:53:08.655532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 183/359] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:53:08 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 17:53:08.666947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:08.678648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-05dc37e7-263b-40ef-9444-953191063bcd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1522 microversion: 2.1 time: 0.357145 Nov 24 17:53:08.681498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:08.692579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:08.693158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 177/360] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:08.701010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:08.703981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:08.707433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.713070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.714219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.714861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.730979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.731843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.732694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:08.733198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:08.858182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0c302cc8-b617-43d9-a104-5b8387d7af8f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.198299 Nov 24 17:53:08.861419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 184/361] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:53:08 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b/os-volume_attachments => generated 25 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 17:53:09.086350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:09.096282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-721b76c1-9d4a-4362-9c20-fc6c697c7871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.401029 Nov 24 17:53:09.096737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 178/362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:09.131710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-669326912", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "d999ad69-34a5-4430-8f01-a48e3a42bfc5"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:09.215088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] validate_networks() for [('d999ad69-34a5-4430-8f01-a48e3a42bfc5', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:53:09.699183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:09.699881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:09.707959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:09.708725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:09.711478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:09.712229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:09.833825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:53:09.834938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:53:09.835544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:53:09.835991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:53:09.836402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:53:09.845980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:09.846598 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:09.847541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:09.848145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:09.867080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:53:09.871412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Getting quotas for user 6a81c70350ee4996b85c33ec8fedaa55 and project 19932e34745a434a9e17ef9a5fa6aa49. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:53:09.882589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:53:09.885186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:53:09.950381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cea0bfe5-7a80-46ed-a34d-c106dd7c751f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823832 Nov 24 17:53:09.951589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 185/363] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:53:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:53:09.961255 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:09.969747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bb530d34-4c76-4d19-aa68-b1151b53d90f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:09.971027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bb530d34-4c76-4d19-aa68-b1151b53d90f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:09.985824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-530cfeab-1dcd-4d6e-8b7e-f691cd057bd1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1502 microversion: 2.1 time: 0.290195 Nov 24 17:53:09.986587 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 179/364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1502 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:10.004895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e65b18af-e106-48a5-b44e-898f832e378d"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:10.006332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:10.023108 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.023627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.024427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.024974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.079130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bb530d34-4c76-4d19-aa68-b1151b53d90f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:10.086991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] HTTP exception thrown: Cannot 'attach_volume' instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 while it is in vm_state rescued Nov 24 17:53:10.087773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Returning 409 to user: Cannot 'attach_volume' instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 while it is in vm_state rescued {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:53:10.088622 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3dc94a6f-03af-4446-b7aa-ed6fa259325b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087444 Nov 24 17:53:10.088979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 180/365] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:53:09 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 24 17:53:10.097556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:10.098203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:10.103847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bb530d34-4c76-4d19-aa68-b1151b53d90f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1217 microversion: 2.1 time: 0.146433 Nov 24 17:53:10.107950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.108457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.109371 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.110307 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.118499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 186/366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:09 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:10.124379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:10.124989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:10.149256 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.150203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.150849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.150947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.293287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cab87489-629a-4eab-9257-1e702629ff6b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action" status: 202 len: 0 microversion: 2.1 time: 0.198977 Nov 24 17:53:10.298532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 181/367] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:53:10 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 17:53:10.336893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:10.338369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:10.367316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.367949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.368845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:10.374460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:10.456069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:10.484568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5ca6098a-b91b-4f54-9feb-2059f2234f10 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.364853 Nov 24 17:53:10.488948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 187/368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:11.126827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:11.127481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:11.135979 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:11.136777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:11.140893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:11.142330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:11.151855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:11.163645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1d546fc2-40a8-4db9-baea-a3bf564dcde1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1510 microversion: 2.1 time: 0.855045 Nov 24 17:53:11.165026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 182/369] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1510 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:11.300711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:11.309828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-99dd3e5a-2054-4773-9c2b-7d0c6eb64142 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1269 microversion: 2.1 time: 0.187819 Nov 24 17:53:11.310554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 188/370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:11 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:11.502046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:11.503053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:11.521442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:11.522072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:11.523671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:11.526216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.087295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:12.099036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bf463f54-39d5-46e8-bb41-b0dbcfc1070e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.600974 Nov 24 17:53:12.099994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 183/371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:12.195423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f48f97c0-444c-46e1-a665-05a1dde84797", "device": "/dev/sdb"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:12.196088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:12.196619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:12.198770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:12.209438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.210369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.211317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.211937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.215043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.215486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.216287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.216717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.557011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:12.565924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ad9642c4-65f3-4850-9792-7d8a8b7f45cd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1510 microversion: 2.1 time: 0.387049 Nov 24 17:53:12.579676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 189/372] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:12.579676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:12.579676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:12.621229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.628372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.645422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:12.647718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:12.877852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fe55958c-9bdc-4655-8178-66df1e69cfa9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "POST /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687189 Nov 24 17:53:12.883695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 184/373] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:53:12 2021] POST /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:12.934120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:12.946220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-57bdc221-6379-4a5d-a266-d24d23d8b42e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1275 microversion: 2.1 time: 0.370368 Nov 24 17:53:12.948431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 190/374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:12 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:13.120935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:13.121944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:13.156161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:13.156796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:13.161206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:13.162826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:13.584981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:13.585594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:13.605665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:13.605989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:13.612670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:13.613445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:13.865455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:13.888286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ea458ab8-17dc-411d-93c0-4b699e16634e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.773719 Nov 24 17:53:13.889648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 185/375] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:13.985646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:13.992405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:13.992851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:13.998554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6452e60a-b561-40fb-a6a5-fc17ddc1b52e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1510 microversion: 2.1 time: 0.418481 Nov 24 17:53:13.999785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 191/376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:14.017452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:14.018180 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:14.019460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:14.020184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:14.294450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Action: 'create', calling method: .version_select at 0x7f8b0bdf9280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1813511141"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:14.320706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for project 7f9fe515b48740349e895a3c54d63a46. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:53:14.324507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for user f5574b71257949beac538ca9b8cd753d and project 7f9fe515b48740349e895a3c54d63a46. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:53:14.516010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:14.525903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6d755a3e-6ec5-4669-85c3-0342a52482a9 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.537627 Nov 24 17:53:14.526467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 186/377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:13 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:14.690737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for project 7f9fe515b48740349e895a3c54d63a46. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:53:14.694793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for user f5574b71257949beac538ca9b8cd753d and project 7f9fe515b48740349e895a3c54d63a46. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:53:14.708305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-39af89ca-ef9c-471e-8c33-ba941a3fab84 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.417790 Nov 24 17:53:14.719636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 192/378] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Nov 24 17:53:14 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:14.767994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1421385029", "imageRef": "67aa2a16-f0cd-460c-b511-2a200cc4bad6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1813511141", "networks": [{"uuid": "4dd6e6a2-d0cd-4e24-a134-c44ba8db7c3a"}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:14.836212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] validate_networks() for [('4dd6e6a2-d0cd-4e24-a134-c44ba8db7c3a', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 17:53:14.912569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:14.913396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:14.920918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:14.921269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:14.922097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:14.922480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.165555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:15.189806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aa7c6cd0-64b9-46b5-a73b-a3dbd36fc309 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.283178 Nov 24 17:53:15.191957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 193/379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:15.197662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:15.198733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:15.214195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:15.215347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.216799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:15.217533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.444385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:15.453635 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7f2fa14e-a5a8-468f-b15e-b80c166ec4e0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1516 microversion: 2.1 time: 0.260808 Nov 24 17:53:15.454207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 194/380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:15.458727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-b6077831-c853-49a6-976a-014cae8cbcd1 req-cfa4b5fc-a973-42ae-b486-33c4578b0ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5719f540-c586-4e6a-aebe-53ae3101c2fb", "tag": "d4a31d7c-2957-4b24-b24e-6d27d0f57bfb"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:15.461217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:53:15.461217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:53:15.475555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-b6077831-c853-49a6-976a-014cae8cbcd1 req-cfa4b5fc-a973-42ae-b486-33c4578b0ffe service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:15.476093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-b6077831-c853-49a6-976a-014cae8cbcd1 req-cfa4b5fc-a973-42ae-b486-33c4578b0ffe service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.493969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-b6077831-c853-49a6-976a-014cae8cbcd1 req-cfa4b5fc-a973-42ae-b486-33c4578b0ffe service nova] Creating event network-changed:d4a31d7c-2957-4b24-b24e-6d27d0f57bfb for instance 5719f540-c586-4e6a-aebe-53ae3101c2fb on hv-cinder-81857 Nov 24 17:53:15.499033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-b6077831-c853-49a6-976a-014cae8cbcd1 req-cfa4b5fc-a973-42ae-b486-33c4578b0ffe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043637 Nov 24 17:53:15.499878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 195/381] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:53:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:15.546044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:15.547271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:15.559458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:15.560662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.561716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:15.562869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:15.777618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:15.789991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2bf92946-50bb-46f7-abca-8957a00082c2 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.250036 Nov 24 17:53:15.791655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 196/382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:15 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:16.112350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 17:53:16.112863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 17:53:16.113297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 17:53:16.113695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 17:53:16.114117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 17:53:16.122451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.122889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:16.123720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.124148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:16.141367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for project 7f9fe515b48740349e895a3c54d63a46. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 17:53:16.145299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Getting quotas for user f5574b71257949beac538ca9b8cd753d and project 7f9fe515b48740349e895a3c54d63a46. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 17:53:16.156403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 17:53:16.158728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67aa2a16-f0cd-460c-b511-2a200cc4bad6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 17:53:16.210218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:16.210565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f58a2d08-dd96-4a42-8c4d-8074500e6e86 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446000 Nov 24 17:53:16.210802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:16.212071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 187/383] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 17:53:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 17:53:16.222876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.223193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-abdce022-781f-406a-96cd-372f08258267 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:16.223451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:16.224029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-abdce022-781f-406a-96cd-372f08258267 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:16.224515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.225403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:16.324802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-abdce022-781f-406a-96cd-372f08258267 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:16.337351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-abdce022-781f-406a-96cd-372f08258267 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1259 microversion: 2.1 time: 0.119593 Nov 24 17:53:16.339082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 188/384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:16 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1259 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:16.521244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:16.534290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cbc02a96-59cc-4a61-b089-e72127fd52a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.328344 Nov 24 17:53:16.536065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 197/385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:16.807848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:16.808604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:16.816136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.816700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:16.817583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:16.818739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.004181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:17.005086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:17.013230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.013677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.014474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.015236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.135556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:17.144330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6b6deb24-e020-4bd7-95e3-f5d2f434fa2f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.340376 Nov 24 17:53:17.144909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 189/386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:16 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:17.354530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:17.355214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:17.355952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:17.362855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.363305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.364016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6ce75f69-d64e-4dcd-9e27-fc234f96dc3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1516 microversion: 2.1 time: 0.364709 Nov 24 17:53:17.364137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.364542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.364653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 198/387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1516 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:17.380423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15113707-47a1-4c9c-9c33-1bbaa7ca3804"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:17.382306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:17.389431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.389879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.390644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.391075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.480877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:17.488892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e062550e-ec73-46d8-aa0c-9015b174f744 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1311 microversion: 2.1 time: 0.138453 Nov 24 17:53:17.489443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 190/388] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:17 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:17.552975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:17.554350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:17.561783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.562218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.562975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:17.563401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:17.767929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:17.776681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b21a7890-5d89-45d2-b725-85b594e265a9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.227802 Nov 24 17:53:17.777243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 191/389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:18.162293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:18.163157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:18.170669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.171110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:18.171898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.172332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:18.362823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:18.371208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-955430cc-62cf-4991-93f5-be7dd46a410c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.213250 Nov 24 17:53:18.371853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 192/390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:18 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:18.507342 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:18.507970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:18.515199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.515666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:18.516424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.516853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:18.800626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:18.809812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aeea3a44-bd59-407f-bba9-98d47475ecc8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1311 microversion: 2.1 time: 0.307059 Nov 24 17:53:18.810401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 193/391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:18 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1311 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:18.814584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:18.815358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:18.823393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.823863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:18.824624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:18.825054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:19.031028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:19.039550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fd85f040-d2f7-4e72-be20-7f889c3144a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.228224 Nov 24 17:53:19.040164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 194/392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:19.388527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:19.389175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:19.396361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:19.396797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:19.397549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:19.397973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:19.602542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:19.610593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a23e313e-97c4-4f61-a06c-c632633e2f59 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.225765 Nov 24 17:53:19.611146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 195/393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:19 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:19.828648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:19.829381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:19.844078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:19.844749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:19.845691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:19.846113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:19.962574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c0c16e9c-5d6a-47a8-8dbf-80f3ab367df1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.585600 Nov 24 17:53:19.963952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 199/394] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Nov 24 17:53:17 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 194 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:53:19.986422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:19.998127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fb4dd274-c86a-4b1d-b683-35e12a18eed3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1311 microversion: 2.1 time: 0.173855 Nov 24 17:53:19.999651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 196/395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:19 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:20.058828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:20.059557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:20.068947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:20.069676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:20.070677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:20.071340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:20.379346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:20.389477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-122ce0f1-7e35-4f48-9993-3a2049f54dea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.335030 Nov 24 17:53:20.390958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 200/396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:20.628466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:20.629203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:20.636706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:20.637376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:20.638154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:20.638586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:21.019360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:21.020260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:21.031715 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:21.034095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:21.035336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:21.036188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:21.050158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:21.061401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-97b66abf-5d0b-402a-b06d-aa80b54b329b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.437130 Nov 24 17:53:21.064756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 197/397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:20 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:21.407679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:21.408585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:21.425308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:21.437951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:21.438833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:21.439303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:21.579519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:21.594050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6e549b57-be11-444d-81da-17a00c36e0cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.579323 Nov 24 17:53:21.595272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 201/398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:21 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:21.907436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:21.920386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a3cbdfe7-9b6c-4bf0-94b0-92f3efcc4b6e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.516141 Nov 24 17:53:21.931243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 198/399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:22.081149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:22.081816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:22.088956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-0b892381-95f3-459c-a7c6-b082c3c32073 req-40a96c1b-4fe9-4866-9d4f-041c8354431f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5719f540-c586-4e6a-aebe-53ae3101c2fb", "name": "network-vif-plugged", "status": "completed", "tag": "d4a31d7c-2957-4b24-b24e-6d27d0f57bfb"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:22.090807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:53:22.090807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:53:22.091573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.092374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.093677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.094317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.109238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-0b892381-95f3-459c-a7c6-b082c3c32073 req-40a96c1b-4fe9-4866-9d4f-041c8354431f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.110346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-0b892381-95f3-459c-a7c6-b082c3c32073 req-40a96c1b-4fe9-4866-9d4f-041c8354431f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.131594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-0b892381-95f3-459c-a7c6-b082c3c32073 req-40a96c1b-4fe9-4866-9d4f-041c8354431f service nova] Creating event network-vif-plugged:d4a31d7c-2957-4b24-b24e-6d27d0f57bfb for instance 5719f540-c586-4e6a-aebe-53ae3101c2fb on hv-cinder-81857 Nov 24 17:53:22.136400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-0b892381-95f3-459c-a7c6-b082c3c32073 req-40a96c1b-4fe9-4866-9d4f-041c8354431f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052464 Nov 24 17:53:22.137279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 199/400] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:53:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:22.332822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:22.341444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bfbd35c9-9a94-49be-8486-1ea9546f456e tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.264284 Nov 24 17:53:22.342006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 202/401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:22 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:22.612976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:22.613676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:22.622081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.622558 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.623366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.623826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.866798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:22.874968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a123ce10-25e9-45d4-8cbb-109975438126 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.266070 Nov 24 17:53:22.875679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 200/402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:22 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:22.938467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:22.939099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:22.946406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.946856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:22.947651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:22.948086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:23.159689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:23.169643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-29a03dec-4eaa-4cad-929a-d11b40f0d231 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.234829 Nov 24 17:53:23.170291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 203/403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:23.358468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:23.359200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:23.377104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:23.377809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:23.378768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:23.379356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:23.620208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:23.628550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-97b59219-5a87-490d-aeb6-a1fd54d982ce tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.273932 Nov 24 17:53:23.629112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 201/404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:23 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:23.891053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:23.891953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:23.900477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:23.901120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:23.901915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:23.902301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:24.121806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:24.129895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ebe87356-0e04-43ba-a979-62b670cdbdeb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.242713 Nov 24 17:53:24.130390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 204/405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:23 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:24.187953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:24.188583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:24.196685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:24.197127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:24.197906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:24.198332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:24.435047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:24.444450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-59d89db6-be91-4da0-88b7-ccb34678c254 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.260128 Nov 24 17:53:24.445006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 202/406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:24.645888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:24.647097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:24.654594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:24.655040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:24.655848 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:24.656280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:24.860731 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:24.870470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-20e6697d-c403-48d0-bcd2-13c6ab92217c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.228691 Nov 24 17:53:24.871040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 205/407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:24 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:25.147214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:25.147856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:25.154999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.155445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:25.156352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.156711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:25.360335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:25.369078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-216d76da-b0a2-4b13-83aa-34bbc2cbc172 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.225744 Nov 24 17:53:25.369636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 203/408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:25 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:25.463152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:25.463846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:25.471523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.472012 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:25.472912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.473331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:25.684486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:25.693685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-337c3c56-409f-4efb-ae87-ad70eb03a2fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.234699 Nov 24 17:53:25.694394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 206/409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:25.889419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:25.890069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:25.898125 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.898563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:25.899326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:25.899787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:26.124361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:26.132960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-864fce61-7254-4966-92d3-50e881d001ec tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.247148 Nov 24 17:53:26.133527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 204/410] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:25 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:26.387951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:26.389170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:26.397838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:26.398599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:26.400158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:26.400837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:26.623407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:26.632763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d5e8527-e689-416e-9ff1-3d326cf64051 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.249726 Nov 24 17:53:26.634523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 207/411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:26 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:26.712269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:26.713050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:26.721141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:26.721768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:26.723001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:26.723529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:26.981579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:26.991537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-24ab9dd1-3c7c-453b-b9a2-8b391a96e7cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.284106 Nov 24 17:53:26.992222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 205/412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:27.150995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:27.151897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:27.160490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:27.161219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:27.163177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:27.163828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:27.407246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:27.417128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6056e6e2-5355-460e-a202-b97067dce28b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.270261 Nov 24 17:53:27.418520 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 208/413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:27 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:27.650918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:27.651795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:27.671829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:27.672277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:27.673049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:27.673473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:27.930754 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:27.941586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d0f7b728-f940-45e3-a2ca-97651839ce16 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.294648 Nov 24 17:53:27.942732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 206/414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:27 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:28.010307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:28.010977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:28.018846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.019458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:28.020277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.021035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:28.248925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:28.259139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5b2e7b01-65c3-477f-a481-f6b703550b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.253272 Nov 24 17:53:28.260291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 209/415] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:28.436548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:28.437911 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:28.446370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.447166 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:28.448323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.448975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:28.689447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:28.703142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7ad51388-af16-4754-b80b-021e21c195e4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.270511 Nov 24 17:53:28.707949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 207/416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:28 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:28.957931 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:28.959483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:28.967283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.968080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:28.969126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:28.969751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:29.184144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:29.192453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2e2d11e4-3080-427f-a26d-36cefe3d55c7 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.238077 Nov 24 17:53:29.194720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 210/417] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:28 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:29.276480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:29.277380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:29.284616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:29.285064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:29.285833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:29.286282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:29.491494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:29.500529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9b8cfcfe-c8be-42f9-95fb-ed1dc7bd59b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.227716 Nov 24 17:53:29.501398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 208/418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:29.721942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:29.722501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:29.730367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:29.730798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:29.731561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:29.732011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:29.971544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:29.982061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d88d8c0-9a35-49e4-9ee9-dbe65e850ccc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.263455 Nov 24 17:53:29.982728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 211/419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:29 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:30.216169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:30.216944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:30.226926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:30.227766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:30.228621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:30.229124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:30.463304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:30.471843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-224fcc0c-cf2f-4c89-919b-5d7a5cc292ec tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.265517 Nov 24 17:53:30.472502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 209/420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:30 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:30.519122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:30.519755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:30.527726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:30.528170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:30.529047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:30.529483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:30.799081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:30.808692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b17e3d71-e38e-4c31-8342-3d19d869f824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.293215 Nov 24 17:53:30.809268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 212/421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:31.001621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:31.002202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:31.010851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.011380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:31.012638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.012638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:31.218444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:31.228078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5d727677-8921-4c13-8cf2-be20e0eef212 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.230242 Nov 24 17:53:31.228653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 210/422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:30 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:31.488881 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:31.489488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:31.496898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.497341 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:31.498112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.498543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:31.701264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:31.710140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-68590596-3173-4b37-9615-33675b70f2e5 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.224777 Nov 24 17:53:31.710698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 213/423] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:31 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:31.825958 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:31.826958 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:31.835022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.835519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:31.836353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:31.836787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:32.069080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:32.082436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-69bb0622-c3ed-4e6d-8ad3-4074c1d725ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.259925 Nov 24 17:53:32.083176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 211/424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:32.246099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:32.246689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:32.254139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:32.254704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:32.256649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:32.257155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:32.481265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:32.489498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1c5e6748-798b-45e3-81f8-742be6ef1d87 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.247104 Nov 24 17:53:32.490660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 214/425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:32 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:32.727304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:32.727949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:32.735445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:32.735887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:32.736697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:32.737144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:32.944621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:32.952916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c0d6e291-112f-4725-b5f7-9bf9fd93c343 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.229993 Nov 24 17:53:32.953474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 212/426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:32 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:33.100135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:33.100852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:33.108341 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.108816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:33.109626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.110059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:33.342370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:33.354064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a76a9084-dd0a-4724-aa80-49c25b5fb692 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.258203 Nov 24 17:53:33.360003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 215/427] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:33.507075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:33.508382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:33.517991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.518513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:33.519374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.519907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:33.727227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:33.736176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9f050ab7-aef0-4317-ba96-f8ee6c4f8634 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.233179 Nov 24 17:53:33.736934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 213/428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:33 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:33.970437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:33.970954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:33.978640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.979787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:33.979901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:33.980300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:34.185299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:34.193410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f8adce4a-104d-42dd-bcbf-b4f097945d31 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.226597 Nov 24 17:53:34.194116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 216/429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:33 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:34.371582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:34.372438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:34.379593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:34.380082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:34.380976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:34.381409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:34.754997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:34.756222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:34.774311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:34.774758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:34.775539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:34.779973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:34.906521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:34.919955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-74681d14-15f2-4ab1-b960-71b485bac23e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1720 microversion: 2.1 time: 0.551821 Nov 24 17:53:34.920862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 214/430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1720 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:35.113831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:35.128279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-175f0e95-8846-4959-b5a9-95b5a9047a94 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.377380 Nov 24 17:53:35.132390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 217/431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:34 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:35.210724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:35.211775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:35.219358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:35.220083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:35.221074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:35.221695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:35.700634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:35.712148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-19eaeeab-b8d2-4b3f-87f2-76970b36fded tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.505673 Nov 24 17:53:35.714729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 215/432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:35 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:35.937224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:35.937823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:35.957798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-a5e0be5f-3105-431d-8060-85eeb7f883a2 req-65ae6b6d-ccd1-486c-a482-64ecd49f6402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f3309e-4d8f-4562-8be3-1ee956122852", "tag": "1fa4f15a-1ecf-4e05-834f-c09fef5e4202"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:35.959672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:53:35.959672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:53:35.959912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:35.960250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:35.961247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:35.961892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:35.974310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a5e0be5f-3105-431d-8060-85eeb7f883a2 req-65ae6b6d-ccd1-486c-a482-64ecd49f6402 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:35.974755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-a5e0be5f-3105-431d-8060-85eeb7f883a2 req-65ae6b6d-ccd1-486c-a482-64ecd49f6402 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.003363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-a5e0be5f-3105-431d-8060-85eeb7f883a2 req-65ae6b6d-ccd1-486c-a482-64ecd49f6402 service nova] Creating event network-changed:1fa4f15a-1ecf-4e05-834f-c09fef5e4202 for instance c4f3309e-4d8f-4562-8be3-1ee956122852 on hv-cinder-81857 Nov 24 17:53:36.010949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-a5e0be5f-3105-431d-8060-85eeb7f883a2 req-65ae6b6d-ccd1-486c-a482-64ecd49f6402 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056695 Nov 24 17:53:36.012764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 216/433] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:53:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:36.157205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:36.158303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:36.167436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.168024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.169128 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.169759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.248577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:36.257653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4b9d53ed-37c9-48b2-bfa9-8c104ef70975 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1697 microversion: 2.1 time: 0.324259 Nov 24 17:53:36.258220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 218/434] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1697 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:36.274660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-34d0691d-5eec-48aa-8b19-b6574954eb89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:36.282191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34d0691d-5eec-48aa-8b19-b6574954eb89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.282707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34d0691d-5eec-48aa-8b19-b6574954eb89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.340955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-34d0691d-5eec-48aa-8b19-b6574954eb89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Going to try to start instance {{(pid=100949) start /opt/stack/nova/nova/compute/api.py:2625}} Nov 24 17:53:36.445459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-34d0691d-5eec-48aa-8b19-b6574954eb89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 202 len: 0 microversion: 2.1 time: 0.174375 Nov 24 17:53:36.446381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 219/435] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:53:36 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:53:36.455924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:36.456617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:36.465603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.466055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.466853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.467345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.508936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:36.520727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-41e3d257-a4b4-4fd5-a0ee-a7e9f24bc924 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.367649 Nov 24 17:53:36.522188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 217/436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:36 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:36.664087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:36.673033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9df8de4a-2656-4190-a5c9-7a266d3df871 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.221746 Nov 24 17:53:36.673586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 220/437] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:36.730172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:36.730881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:36.738092 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.738535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.739280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:36.740021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:36.967424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:36.976251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-283cadb1-d9ad-4ab3-8f7d-58d47f7cdd49 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.249708 Nov 24 17:53:36.976807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 218/438] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:36 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:37.537242 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:37.537863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:37.545285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:37.545740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:37.546497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:37.546924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:37.690344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:37.690951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:37.698683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:37.699130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:37.699932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:37.700365 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:37.741617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:37.749518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e106d9be-dd47-43bf-902d-6cd5007b68db tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.216197 Nov 24 17:53:37.750072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 221/439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:37 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:37.894360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:37.903061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0190cd7d-26f3-475e-a844-4f1576459e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.216460 Nov 24 17:53:37.903634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 219/440] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:37.993128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:37.993733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:38.000972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.001414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.002222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.002597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.199368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:38.207269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a3a9fd19-ff9f-4697-81d6-cd7a256f2067 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.218314 Nov 24 17:53:38.207850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 222/441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:37 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:38.766260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:38.766879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:38.777490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.778012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.778792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.779229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.920741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:38.921425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:38.929201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.929641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.930400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:38.930827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:38.978728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:38.986901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-139cecc1-9571-41be-bcef-a771ac26f7c1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1317 microversion: 2.1 time: 0.224425 Nov 24 17:53:38.987470 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 220/442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:38 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:39.131741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:39.145093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-392ff857-76c0-4582-b784-63758a988116 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.227920 Nov 24 17:53:39.145676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 223/443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:39.225475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:39.226154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:39.234340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:39.235038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:39.236055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:39.236640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:39.580542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:39.590670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-00a6f0c9-5a30-421a-8883-f8337c040a05 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.369156 Nov 24 17:53:39.591458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 221/444] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:39 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:40.004015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:40.004569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:40.011712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.012154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.012912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.013340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.168097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:40.168646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:40.187001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.187449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.188266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.188700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.222358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:40.234413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f607ff3d-7d1b-4223-b8a2-4cb9590424d7 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1507 microversion: 2.1 time: 0.233873 Nov 24 17:53:40.236969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 224/445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:39 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:40.408882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:40.421896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-09a29ba0-764c-408b-9f21-418edf36a73f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.258152 Nov 24 17:53:40.422823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 222/446] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:40.608051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:40.608802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:40.617079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.617603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.618458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:40.618995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:40.817264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:40.825316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2dc57083-5efb-47ef-a79e-8cbc6d342ebb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.220947 Nov 24 17:53:40.825872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 225/447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:40 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:41.441638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:41.442247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:41.449838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:41.450286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:41.451057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:41.451491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:41.648748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:41.657366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-da39933e-bd47-4743-bcb9-899198fc804a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.219437 Nov 24 17:53:41.657938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 223/448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:41.841714 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:41.842258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:41.849451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:41.849980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:41.850740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:41.851170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:42.047662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:42.056772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2c788de2-f809-4704-a055-336d5c5b5864 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.218720 Nov 24 17:53:42.057335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 226/449] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:41 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:42.674368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:42.674868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:42.682852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:42.683388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:42.684254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:42.684760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:43.055218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:43.064206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f028eb7f-c766-4d3f-889c-37bb0e76819b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.393420 Nov 24 17:53:43.065026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 224/450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:43.073757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:43.074358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:43.082319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:43.082765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:43.085251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:43.085710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:43.286125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:43.295433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7fe2b8e4-4c05-44c4-8ed5-9a40d06fda0c tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.225711 Nov 24 17:53:43.296048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 227/451] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:43 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:44.082844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:44.083482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:44.091127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:44.091574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:44.092364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:44.092797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:44.288266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:44.296970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b38228d2-2a9f-4b2c-b9e4-6de88a25958b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.217812 Nov 24 17:53:44.297526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 225/452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:44.311867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:44.312471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:44.319438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:44.319914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:44.320666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:44.321089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:44.519662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:44.528609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-729e2461-90b0-491a-a934-cb8d21892d98 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.220216 Nov 24 17:53:44.529064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 228/453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:44 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:45.313975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:45.314582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:45.321794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:45.322237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:45.323001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:45.323436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:45.514503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:45.523074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-066b6ed5-d31f-41e3-80f7-16b406aa0655 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.212791 Nov 24 17:53:45.523656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 226/454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:45.544859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:45.545457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:45.553194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:45.553629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:45.554317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:45.554740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:45.748437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:45.756674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5f1130c5-6a19-416a-8799-f8885d4108ff tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.215700 Nov 24 17:53:45.757231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 229/455] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:45 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:46.540456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:46.541172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:46.548554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:46.548997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:46.549758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:46.550184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:46.773618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:46.773992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:46.781171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:46.781610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:46.782606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:46.783041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:46.823726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:46.832803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4fd36c68-9ef7-45a7-8e3f-bedb86a58ce0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.296444 Nov 24 17:53:46.833733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 227/456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:46.976910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:46.985021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-19d8da0a-0096-4bca-ad0f-ceb58e512bf8 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.215515 Nov 24 17:53:46.985577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 230/457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:46 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:47.849778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:47.850374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:47.858346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:47.858793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:47.859614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:47.860048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:48.001973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:48.002668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:48.013588 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:48.013962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:48.014739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:48.015169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:48.089544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:48.098314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-11cbc666-0d43-4b77-9bf6-31407402c400 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.252053 Nov 24 17:53:48.099068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 228/458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:48.108784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-fbc397a1-4ac6-41ff-ab44-ca739f0b5b0f req-8edde4bb-a207-45ab-9425-0a581e61b88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f3309e-4d8f-4562-8be3-1ee956122852", "name": "network-vif-plugged", "status": "completed", "tag": "1fa4f15a-1ecf-4e05-834f-c09fef5e4202"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:53:48.110556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:53:48.110556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 17:53:48.120368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-fbc397a1-4ac6-41ff-ab44-ca739f0b5b0f req-8edde4bb-a207-45ab-9425-0a581e61b88b service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:48.120800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-fbc397a1-4ac6-41ff-ab44-ca739f0b5b0f req-8edde4bb-a207-45ab-9425-0a581e61b88b service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:48.137310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-fbc397a1-4ac6-41ff-ab44-ca739f0b5b0f req-8edde4bb-a207-45ab-9425-0a581e61b88b service nova] Creating event network-vif-plugged:1fa4f15a-1ecf-4e05-834f-c09fef5e4202 for instance c4f3309e-4d8f-4562-8be3-1ee956122852 on hv-cinder-81857 Nov 24 17:53:48.142256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-fbc397a1-4ac6-41ff-ab44-ca739f0b5b0f req-8edde4bb-a207-45ab-9425-0a581e61b88b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038550 Nov 24 17:53:48.143291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 229/459] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 17:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:48.233855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:48.242974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-933b76bd-0f4e-4cdd-99bb-5b4a0c2d681a tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.244633 Nov 24 17:53:48.243869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 231/460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:47 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:49.116234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:49.116865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:49.124310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:49.124760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:49.125520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:49.125955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:49.260264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:49.260992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:49.267966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:49.268401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:49.269148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:49.269575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:49.327450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:49.336592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2c949c44-d0fc-4772-91a1-8a5e6db78f4c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.224688 Nov 24 17:53:49.337160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 230/461] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:49.470699 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:49.478920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b933ada7-bc7d-4059-b70b-d27224db2b35 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1359 microversion: 2.1 time: 0.222466 Nov 24 17:53:49.479470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 232/462] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:49 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:50.354768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:50.355377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:50.362612 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.363066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.363863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.364410 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.500375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:50.500375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:50.503315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.503805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.504569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.505046 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.562500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:50.571682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-10e736e2-a3b3-4fcd-8657-81dcb9327c98 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.220634 Nov 24 17:53:50.572258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 231/463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:50.706545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:50.715177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-09c182df-d8c8-4c7e-abf9-6eea026f5382 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1548 microversion: 2.1 time: 0.223236 Nov 24 17:53:50.715765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 233/464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:50 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:53:50.731724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:50.732361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:50.739764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.740361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.741130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.741566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.941494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:50.950379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0ceba9e2-a401-45cd-931f-a1c9b87a9efb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1548 microversion: 2.1 time: 0.222339 Nov 24 17:53:50.950940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 232/465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:50 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:50.966221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:50.969557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 17:53:50.969557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 17:53:50.970565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:50.971290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Searching by: {'deleted': False, 'project_id': '7f9fe515b48740349e895a3c54d63a46'} {{(pid=100949) get_all /opt/stack/nova/nova/compute/api.py:2855}} Nov 24 17:53:50.976640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.977076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:50.977865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:50.978288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:51.071712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.multi_cell_list [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=100949) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Nov 24 17:53:51.162938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-34fef5c7-b7a5-4238-ae3f-71f453f10bcf tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200231 Nov 24 17:53:51.163512 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 234/466] 10.222.0.64 () {58 vars in 1124 bytes} [Wed Nov 24 17:53:50 2021] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:53:51.173696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:51.174305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:51.182589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:51.183030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:51.183836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:51.184276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:51.381438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:51.389807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cde9c0a8-bc2c-46de-88dc-bf3a00d77962 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1548 microversion: 2.1 time: 0.219764 Nov 24 17:53:51.390367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 233/467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:51 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:51.588491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:51.589110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:51.597012 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:51.597354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:51.598158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:51.599109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:51.813347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:51.822350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a3bc6695-a4d6-410d-91ff-d625407be4ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.237919 Nov 24 17:53:51.828932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 235/468] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:52.839695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:52.840301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:52.847814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:52.848198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:52.849457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:52.849888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:53.045628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:53.054676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8650196-6a2b-4b39-9648-c4caf7f653c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218658 Nov 24 17:53:53.055250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 234/469] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:54.072188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:54.072799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:54.080621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:54.081067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:54.081828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:54.082259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:54.300818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:54.309954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a8ec83d0-5f48-4794-8206-c9bba9da2c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.241424 Nov 24 17:53:54.310617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 236/470] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:55.326881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:55.327384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:55.335177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:55.335634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:55.336401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:55.336830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:55.537974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:55.547473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2580d877-3aee-42cc-83eb-3db0ad9ca6f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.223924 Nov 24 17:53:55.548511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 235/471] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:56.564768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:56.565373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:56.572580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:56.573016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:56.573770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:56.574194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:56.835034 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:56.843612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d7ad5f1c-75fa-4cc7-9120-37b636bed489 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.282420 Nov 24 17:53:56.844167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 237/472] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:57.860614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:57.861217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:57.869386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:57.869827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:57.870584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:57.871006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:58.071437 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:58.080027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e97aa1cb-95b9-40c0-b659-93787d97dc4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.222995 Nov 24 17:53:58.080590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 236/473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:53:59.096811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:53:59.097408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:53:59.105024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:59.105459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:59.106209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:53:59.106630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:53:59.300068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:53:59.308938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-08ae6b42-b267-43e8-a99e-0fd8c68578a1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.215777 Nov 24 17:53:59.309495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 238/474] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:53:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:00.326703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:00.327339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:00.335445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:00.335918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:00.336681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:00.337113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:00.537704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:00.546571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-051a3626-4f51-40de-b8ad-9e23f94ed44f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.223500 Nov 24 17:54:00.547131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 237/475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:01.563389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:01.564025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:01.571187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:01.571646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:01.572396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:01.572816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:01.775120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:01.783662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8ad5624e-88c2-4bc7-a4b2-16c73aad0f31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.223789 Nov 24 17:54:01.784213 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 239/476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:02.801981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:02.802786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:02.810248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:02.810692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:02.811450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:02.811903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:03.004876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:03.014241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9ae67706-3dc7-444b-9075-ca3a0772a132 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.216498 Nov 24 17:54:03.014806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 238/477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:04.031479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:04.032104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:04.040407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:04.040844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:04.041856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:04.042280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:04.242453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:04.250916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c256b25b-0073-4ac0-a544-93693dcd7bac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.223105 Nov 24 17:54:04.251468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 240/478] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:05.267635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:05.268278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:05.276660 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:05.277111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:05.277871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:05.278304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:05.492347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:05.501547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-00240afd-a4f5-4c50-823a-9cafaac2d559 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.237428 Nov 24 17:54:05.502138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 239/479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:06.518694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:06.519299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:06.526669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:06.527108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:06.527960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:06.528390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:06.724566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:06.733360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-786c04a6-1fab-4c27-ab6d-c36a94b30f03 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218279 Nov 24 17:54:06.733927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 241/480] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:07.750120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:07.750966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:07.759677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:07.760122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:07.760899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:07.761322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:07.981797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:07.990894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-957128e5-d13b-462f-bb89-e978e5775d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.244504 Nov 24 17:54:07.991451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 240/481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:09.008620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:09.009149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:09.016402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:09.016832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:09.017582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:09.018007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:09.218721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:09.227820 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b2f4ccf6-d81f-4adb-9f79-aa4c6255caf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.223627 Nov 24 17:54:09.228423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 242/482] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:10.245442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:10.245967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:10.253209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:10.253651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:10.254919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:10.255355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:10.463500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:10.472220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c5f55510-cbcd-48c3-b2c8-c546ce2eedf4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.230625 Nov 24 17:54:10.472780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 241/483] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:54:11.489772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:11.490402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:11.497552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:11.497991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:11.498744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:11.499194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:11.689237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:11.697928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca1ac0f6-8df1-498b-8df4-5842a6e4d813 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.212608 Nov 24 17:54:11.698485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 243/484] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:12.715336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:12.715903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:12.723657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:12.724106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:12.724854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:12.725276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:12.923050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:12.932399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7ab4958d-02d3-4adb-89d8-5b26150240b8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.220786 Nov 24 17:54:12.932957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 242/485] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:13.949052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:13.949710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:13.960462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:13.961038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:13.961828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:13.962265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:14.159453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:14.168224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e0ecef85-34a6-4580-a33f-519f08e5c084 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.222800 Nov 24 17:54:14.168779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 244/486] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:15.185870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:15.186532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:15.194647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:15.195096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:15.195877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:15.196312 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:15.392207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:15.400860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7e84dfe7-603d-4688-836d-d7b73b2bbaae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218665 Nov 24 17:54:15.401424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 243/487] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:16.418067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:16.418678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:16.426091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:16.426806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:16.427467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:16.427932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:16.626054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:16.635450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fd6e8d15-e4ae-44d7-b2ef-b961fb0af4e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.221313 Nov 24 17:54:16.636122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 245/488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:17.652172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:17.652781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:17.660884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:17.661527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:17.662300 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:17.662730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:17.858702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:17.867256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d881579d-1b61-4426-93d6-230100f9ef1e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218696 Nov 24 17:54:17.867848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 244/489] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:18.884467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:18.885075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:18.892171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:18.892623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:18.893386 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:18.893821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:19.085989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:19.094545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a4fd4340-cad6-4b28-9bf9-4ca497b5514e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.213701 Nov 24 17:54:19.095108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 246/490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:20.112095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:20.112642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:20.119916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:20.120367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:20.121137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:20.121568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:20.325610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:20.335093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6d5747bd-37c0-4a52-b9c4-37eb78a1f2a0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.226748 Nov 24 17:54:20.335673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 245/491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:21.352672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:21.353282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:21.360568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:21.361014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:21.361798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:21.362235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:21.561142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:21.570313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5c3c290b-ec04-428e-9a76-ee559f720da5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.221302 Nov 24 17:54:21.570873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 247/492] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:22.375893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:54:22.376367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 17:54:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:54:22.587507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:22.588063 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:22.595218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:22.595688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:22.596443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:22.596867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:22.848212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:22.856623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-04492436-9aa7-45f4-a743-c295f79bef40 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.272916 Nov 24 17:54:22.857174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 246/493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:54:23.873553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:23.874152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:23.882009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:23.882453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:23.883209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:23.883664 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:24.075036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:24.083612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fa238532-5f46-4fd9-9224-5d44ff736ce3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.213717 Nov 24 17:54:24.084170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 248/494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:25.101207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:25.101762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:25.109038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:25.109489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:25.110260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:25.110699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:25.302862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:25.311642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0a30047d-de05-48de-8764-2b90c38d69fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.214775 Nov 24 17:54:25.312196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 247/495] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:26.329059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:26.329660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:26.337284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:26.337722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:26.338475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:26.338908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:26.546209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:26.555710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5a0d35d6-92a5-4d48-af3a-688a88541d0e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.230313 Nov 24 17:54:26.556312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 249/496] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:27.572901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:27.574120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:27.581516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:27.582277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:27.583367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:27.584047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:27.787040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:27.795821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-34adbe21-3e6e-41f8-af69-3d367539e0f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.226505 Nov 24 17:54:27.796378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 248/497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:54:28.812727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:28.813327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:28.820729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:28.821170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:28.821925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:28.822353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:29.016663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:29.025126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3a10f4c7-2a5f-46e5-bc37-39ab7d5fe7f0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.216121 Nov 24 17:54:29.025690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 250/498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:30.042436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:30.043036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:30.051041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:30.051490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:30.052290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:30.052718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:30.249798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:30.258769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-21ea904b-d20e-485f-a226-2e1f5badfbc5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.220411 Nov 24 17:54:30.259316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 249/499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:31.275826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:31.276424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:31.283484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:31.283944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:31.285749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:31.286282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:31.491150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:31.499581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-59b5f2a3-bf2b-4dd6-9970-f1c24a5043c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.227427 Nov 24 17:54:31.500180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 251/500] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:32.516583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:32.517199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:32.524707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:32.525158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:32.525927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:32.526359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:32.721766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:32.731080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9e7635e6-a96e-4684-8462-83cef9d77888 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218097 Nov 24 17:54:32.731664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 250/501] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:33.748271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:33.748877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:33.756716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:33.757159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:33.757922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:33.758356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:33.953970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:33.963209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-50a0791e-a082-49c4-b8ab-48c65dd92c63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.218557 Nov 24 17:54:33.963813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 252/502] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:34.980714 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:34.981230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:34.988645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:34.989094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:34.989888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:34.990348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:35.198143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:35.207426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ae0e4410-13fb-436a-94a5-25cd2dc049fd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.229918 Nov 24 17:54:35.216559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 251/503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:54:36.225104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:36.225843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:36.232862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:36.233304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:36.234060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:36.234495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:36.466177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:36.476105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8f06a6d9-acb5-4d8c-b6fe-460a7a3d94d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1706 microversion: 2.1 time: 0.255257 Nov 24 17:54:36.476685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 253/504] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1706 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:37.493260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:37.493966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:37.501329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.501855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:37.502700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.503879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:37.647043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:54:37.648640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:37.656225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.656683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:37.657460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.657890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:37.717485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lazy-loading 'flavor' on Instance uuid d195ce54-bd42-4deb-b7de-c80fcfcd3437 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:54:37.912423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:37.922029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dd9150dd-e178-4cd2-8d08-fb00c7f742d0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1710 microversion: 2.1 time: 0.432401 Nov 24 17:54:37.923024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 252/505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1710 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:37.968628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6470a495-9c66-4491-813d-4909dc947546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action" status: 200 len: 32 microversion: 2.1 time: 0.325760 Nov 24 17:54:37.973869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 254/506] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:54:37 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 17:54:37.981874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:37.983781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:37.994682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.995213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:37.996110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:37.996619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:38.308788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:38.318835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ec71635-5afa-445f-838c-54ea8ee55d12 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.343533 Nov 24 17:54:38.319740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 253/507] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:39.337384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:39.338014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:39.345441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:39.345882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:39.346634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:39.347735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:39.544347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:39.553769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9f6bd676-5ce7-4a67-b1b1-f21498789771 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.220575 Nov 24 17:54:39.554316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 255/508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:40.570451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:40.571050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:40.578589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:40.579038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:40.579835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:40.580272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:40.848560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:40.857064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0449be74-36de-4cc0-96b6-fd6425322583 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.290293 Nov 24 17:54:40.857628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 254/509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:41.873782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:41.874381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:41.882244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:41.882680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:41.883426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:41.883877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:42.083834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:42.092255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1b3e4284-710e-4d63-9a66-ee0950c94a2e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.222092 Nov 24 17:54:42.092816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 256/510] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:43.109110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:43.109694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:43.116980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:43.117430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:43.118205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:43.126408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:43.311592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:43.320229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-36538800-4914-41ef-ba2f-fdb64313bfe2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.214804 Nov 24 17:54:43.320790 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 255/511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:44.339166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:44.339946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:44.347339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:44.347827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:44.348599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:44.349031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:44.551724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:44.560323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-db745abe-5894-498b-8709-4aecb1ff6b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.226291 Nov 24 17:54:44.560879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 257/512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:45.577906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:45.578453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:45.586347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:45.586800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:45.587568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:45.588022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:45.782845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:45.791684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b3e9e929-a5ed-4934-ad50-80c3bab0fa0d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.217261 Nov 24 17:54:45.792252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 256/513] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:46.807621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:46.808231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:46.815381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:46.816006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:46.816772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:46.817205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:47.008257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:47.016726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a6c71fcd-2e81-4d8c-ac96-8aa7ed006916 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.212738 Nov 24 17:54:47.017287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 258/514] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:48.034619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:48.035550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:48.042793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:48.043239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:48.044034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:48.044468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:48.246759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:48.256043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b5d0a12d-ee0e-4c03-b5f6-57ecaf8113a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.225669 Nov 24 17:54:48.256605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 257/515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:49.272762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:49.273363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:49.280482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:49.280928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:49.282037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:49.282138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:49.481737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:49.491009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d203f2bc-8e1a-4e2b-a517-963538c3525d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.221922 Nov 24 17:54:49.491568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 259/516] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:50.508247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:50.508853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:50.516168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:50.516614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:50.517376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:50.517807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:50.716852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:50.726400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fa5cd6a7-d5c9-433e-a4ee-89164595e4bd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.221716 Nov 24 17:54:50.726972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 258/517] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:54:51.744026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:51.744634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:51.751776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:51.752221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:51.753154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:51.753506 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:51.952245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:51.960696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a87e9ab0-4a16-48fd-a621-2366f3165af2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.220342 Nov 24 17:54:51.961258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 260/518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:52.977620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:52.978155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:52.985408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:52.985884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:52.986643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:52.987845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:53.183503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:53.192891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d109dd21-8b80-4e2e-bcc2-4bf08f7aa57c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.219021 Nov 24 17:54:53.193451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 259/519] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:54.210374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:54.210984 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:54.218163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:54.218603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:54.219367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:54.219830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:54.416661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:54.426643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-366e9c09-e642-48f9-92a4-bab17884e265 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.220527 Nov 24 17:54:54.427218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 261/520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:55.444269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:55.445456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:55.452635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:55.453084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:55.453855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:55.454288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:55.652292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:55.661162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-013fecb4-65b6-4d69-a930-fc703fcc9a1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.221324 Nov 24 17:54:55.661726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 260/521] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:56.677959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:56.678559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:56.686231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:56.686785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:56.687711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:56.688238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:56.895558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:56.904269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3abc54ed-1658-4b8c-aedf-735411ab1abe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.229972 Nov 24 17:54:56.904835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 262/522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:57.922466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:57.923008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:57.930806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:57.931254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:57.932050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:57.932601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.275763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:58.285050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-644bc536-53c9-4c93-8dfa-2ab3c5d1316a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1548 microversion: 2.1 time: 0.366198 Nov 24 17:54:58.285607 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 261/523] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1548 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:54:58.301383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:58.301872 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:58.308963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.309406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.310170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.310599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.477559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] HTTP exception thrown: Cannot 'detach_volume' instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 while it is in vm_state rescued Nov 24 17:54:58.478146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Returning 409 to user: Cannot 'detach_volume' instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 while it is in vm_state rescued {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 17:54:58.478949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c96148d3-9123-4dbe-b2d5-9e39732776c3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments/15113707-47a1-4c9c-9c33-1bbaa7ca3804" status: 409 len: 152 microversion: 2.1 time: 0.181453 Nov 24 17:54:58.479491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 263/524] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:54:58 2021] DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments/15113707-47a1-4c9c-9c33-1bbaa7ca3804 => generated 152 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 17:54:58.487800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 17:54:58.488332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:58.495392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.495870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.496618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.497042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.626945 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-33c08116-6b0a-4636-a6f9-f12400fe508b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action" status: 202 len: 0 microversion: 2.1 time: 0.142853 Nov 24 17:54:58.628471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 262/525] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 17:54:58 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:54:58.636072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:54:58.636918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:54:58.645580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.646040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:58.647412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:54:58.647412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:54:59.011431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:54:59.020249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-172d8218-c9e6-43cf-944d-e281d71adc08 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1556 microversion: 2.1 time: 0.387677 Nov 24 17:54:59.020809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 264/526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:54:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1556 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 17:55:00.038297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:00.039000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:00.046616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:00.047072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:00.047865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:00.048305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:00.239114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:55:00.247586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dedd6beb-71c3-43a6-9fb7-6e69f9bf9e95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1556 microversion: 2.1 time: 0.213555 Nov 24 17:55:00.248159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 263/527] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:55:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:55:01.264978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:01.265515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:01.272814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:01.273259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:01.274019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:01.274456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:01.482438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:55:01.491942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8d37aba0-c618-447e-8910-63f837ffa349 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1556 microversion: 2.1 time: 0.230704 Nov 24 17:55:01.492497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 265/528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:55:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:55:02.509388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:02.510008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:02.517119 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:02.517571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:02.518385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:02.518914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:02.718105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 17:55:02.727997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a55d6a51-797f-4567-882f-cec903af891f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1562 microversion: 2.1 time: 0.222160 Nov 24 17:55:02.728548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 264/529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 17:55:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 17:55:02.840949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:02.841449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:02.848804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:02.849240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:02.849991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:02.850415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:03.013665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lazy-loading 'services' on Instance uuid d195ce54-bd42-4deb-b7de-c80fcfcd3437 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:55:03.148476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5a433448-4ccf-4e6e-8fec-1f00f947cd48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments/15113707-47a1-4c9c-9c33-1bbaa7ca3804" status: 202 len: 0 microversion: 2.1 time: 0.310976 Nov 24 17:55:03.149088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 266/530] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:55:02 2021] DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments/15113707-47a1-4c9c-9c33-1bbaa7ca3804 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:55:03.157157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:03.158127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:03.166143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:03.166854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:03.167652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:03.168094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:03.243244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b6b97bd8-0df7-493f-81e5-27c17ea50f29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089759 Nov 24 17:55:03.243832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 265/531] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:04.255058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:04.256133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:04.263456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:04.263935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:04.264694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:04.265127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:04.330867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-38597d68-8681-4ccd-b4db-bb3638b722e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080179 Nov 24 17:55:04.331335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 267/532] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:05.342062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:05.342960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:05.351311 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:05.351779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:05.352541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:05.352972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:05.415921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-92d2a508-d349-4d72-922d-5cc47be5d04c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077483 Nov 24 17:55:05.416936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 266/533] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:06.427119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:06.428088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:06.435462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:06.436008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:06.436778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:06.437207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:06.501652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1bd75672-0ea8-4c00-98fb-419b62a73da0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078417 Nov 24 17:55:06.502195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 268/534] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:07.512869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:07.513812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:07.522006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:07.522448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:07.523261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:07.523710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:07.592074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-497f110d-e56d-4b56-b2c9-439362e14593 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082986 Nov 24 17:55:07.592636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 267/535] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:08.604972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:08.605899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:08.613793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:08.614234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:08.614977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:08.615405 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:08.678612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ce89aab3-637e-4c8c-b6f3-4a0aaafb85a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077655 Nov 24 17:55:08.679155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 269/536] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:09.690227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:09.692049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:09.699269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:09.699754 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:09.700522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:09.700956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:09.763777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-81573afb-1682-410a-9d7c-65cb0367efc0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077445 Nov 24 17:55:09.764330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 268/537] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:10.775229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:10.776156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:10.783307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:10.783844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:10.785079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:10.785961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:10.849503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e84c53b5-81cf-453f-b1e8-b0be87c4cd71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077933 Nov 24 17:55:10.850051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 270/538] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:11.860815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:11.861759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:11.869085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:11.869530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:11.870294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:11.870728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:11.936352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2a7159d1-6ab4-4cc2-af13-ff606a75c708 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079245 Nov 24 17:55:11.936905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 269/539] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:12.948231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:12.949047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:12.956085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:12.957010 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:12.957752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:12.958173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:13.024768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d8d87e16-4b57-4e57-b97c-baf4b67cf29e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080335 Nov 24 17:55:13.025326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 271/540] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:14.036974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:14.038008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:14.045794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:14.046346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:14.047206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:14.047741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:14.111738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-703756bf-a930-4970-b0e4-b8f3a5122b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079000 Nov 24 17:55:14.112847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 270/541] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:15.124863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:15.125803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:15.133856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:15.134295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:15.135055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:15.135481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:15.201403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d34ab53b-4e89-4931-8149-74e95560a07c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080313 Nov 24 17:55:15.201962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 272/542] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:16.197483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:16.198034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:16.205337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:16.205783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:16.206579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:16.207007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:16.213851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:16.214825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:16.221962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:16.222398 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:16.223252 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:16.224153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:16.289154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-970d45f2-c915-4ff3-b75d-a18b497d976a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078952 Nov 24 17:55:16.289709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 273/543] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:16.370473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lazy-loading 'services' on Instance uuid 38f00b1d-a746-4496-a338-1a6ca81f15c7 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:55:16.519666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-52961176-a4c6-4404-8a44-a65f7330ab17 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments/158bd37a-bb86-4728-8b2d-b7bca6c98d5c" status: 202 len: 0 microversion: 2.1 time: 0.325636 Nov 24 17:55:16.520424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 271/544] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:55:16 2021] DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments/158bd37a-bb86-4728-8b2d-b7bca6c98d5c => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 17:55:17.300672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:17.301835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:17.308940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:17.309372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:17.310116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:17.310541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:17.374107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-92ca7d6b-2db3-4c49-8051-5b3ee0a28368 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077135 Nov 24 17:55:17.374657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 274/545] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:17 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:18.386565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:18.387565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:18.395921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:18.396488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:18.397266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:18.397703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:18.461703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-682c7d62-2554-4778-8bb8-bba1cee4324f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079247 Nov 24 17:55:18.462262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 272/546] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:19.473684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:19.474607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:19.481743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:19.482186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:19.482964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:19.483392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:19.548990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3c1438c6-ed2c-4615-8177-f46545fd7323 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079670 Nov 24 17:55:19.549535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 275/547] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:20.560163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:20.561076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:20.568454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:20.568896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:20.569657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:20.570088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:20.632384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-87a60495-ea95-438c-962b-4ecdc66176d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076049 Nov 24 17:55:20.632925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 273/548] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:21.643769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:21.645169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:21.652393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:21.652836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:21.653590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:21.654018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:21.716283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-511204be-267b-4acc-bdfa-bf6244c90cb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076267 Nov 24 17:55:21.716822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 276/549] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:22.726928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:22.727775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:22.734966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:22.735413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:22.736225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:22.736661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:22.803164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-99920fd0-6384-478d-b94d-0efbf0552602 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080064 Nov 24 17:55:22.803726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 274/550] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:23.814085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:23.814991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:23.822629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:23.823065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:23.823842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:23.824270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:23.885693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f193fb1b-6851-4504-8356-9da3c958bc1d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075339 Nov 24 17:55:23.886225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 277/551] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:24.897526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:24.898636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:24.905859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:24.906576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:24.907349 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:24.907830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:24.971198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7f7f11d6-23f2-4527-8a5d-6ea65088cc1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077879 Nov 24 17:55:24.971906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 275/552] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:25.984011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:25.984842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:25.992681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:25.993128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:25.993879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:25.994304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:26.057738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-719e1eb8-1465-40c6-8d15-0fb6b03bc007 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077489 Nov 24 17:55:26.058296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 278/553] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:27.069240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:27.070809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:27.078043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:27.078496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:27.079260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:27.079729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:27.142536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-47a043da-d2df-48fa-8f69-362231e79d45 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077066 Nov 24 17:55:27.143124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 276/554] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:28.153930 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:28.154838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:28.162774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:28.163216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:28.163999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:28.164434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:28.230695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4aef2037-43d1-45e7-a972-821dd6494a77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080490 Nov 24 17:55:28.231273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 279/555] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:29.242418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:29.243237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:29.250386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:29.250831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:29.251632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:29.252055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:29.321997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8445cdcd-bdad-432b-9ff0-ca6a0062f757 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084196 Nov 24 17:55:29.322583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 277/556] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:30.333106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:30.334006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:30.341200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:30.341587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:30.342339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:30.342775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:30.405145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d211f067-3b78-4de7-bf6f-eff531809aa2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075840 Nov 24 17:55:30.405701 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 280/557] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:31.417036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:31.417932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:31.425088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:31.425527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:31.426770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:31.427199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:31.493027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a4e40b7f-45a7-483b-85c8-2ced82d00d1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079919 Nov 24 17:55:31.493568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 278/558] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:32.505110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:32.506091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:32.513378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:32.513818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:32.514569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:32.514994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:32.580838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-38bce248-966c-47cb-b7fc-22794507b3bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080133 Nov 24 17:55:32.581383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 281/559] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:33.592397 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:33.593235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:33.601043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:33.601484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:33.602234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:33.602661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:33.666229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b2b72c0b-baa8-4e84-b254-fe93c919be71 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077616 Nov 24 17:55:33.667031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 279/560] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:34.677464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:34.678406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:34.685562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:34.686002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:34.686757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:34.687184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:34.750126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-db709d31-9e66-4cf1-8f23-7e3788520f7f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076521 Nov 24 17:55:34.750605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 282/561] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:35.762038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:35.762863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:35.770226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:35.770670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:35.771425 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:35.771876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:35.834017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4dccde14-7f0a-4358-8e88-5b24e80042ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075814 Nov 24 17:55:35.834556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 280/562] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:36.845544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:36.846372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:36.853673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:36.854152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:36.854934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:36.855351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:36.921030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0ffc6bc5-9d7d-4de0-aedf-62ab5f931844 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079314 Nov 24 17:55:36.921580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 283/563] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:37.932295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:37.933120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:37.940327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:37.940776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:37.942049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:37.942480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:38.014315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e58a70c9-cf27-4fda-bc99-20b5531dba6e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085837 Nov 24 17:55:38.014870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 281/564] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:39.023906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 17:55:39.027540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:39.028453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:39.036188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:39.036627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:39.037380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:39.037809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:39.100013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0728a3c8-6a30-4a26-b5b3-7adae4fbb634 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077540 Nov 24 17:55:39.100545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 284/565] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:40.111201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:40.112136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:40.116026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 17:55:40.120827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:40.121276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:40.122034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:40.122464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:40.187791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f489a046-b945-4296-989d-fb850757db69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080323 Nov 24 17:55:40.188333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 282/566] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:41.199228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:41.200154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:41.220675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 49262. Nov 24 17:55:41.224470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:41.224908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:41.225663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:41.226086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:41.288708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bb3b6409-fe6c-4e77-b72a-401f66a66f26 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093253 Nov 24 17:55:41.289249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 285/567] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:42.300014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:42.300916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:42.319560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:42.320028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:42.320808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:42.321257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:42.369793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 49276. Nov 24 17:55:42.386750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-df16d582-8c09-4f90-872f-e93c461021ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090474 Nov 24 17:55:42.387304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 283/568] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:55:43.398937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:43.399780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:43.406845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:43.407266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:43.408154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:43.408580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:43.472122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9923f247-4313-46bf-b8a5-e6c9b8e6e64d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077631 Nov 24 17:55:43.472675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 286/569] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:44.484045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:44.484976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:44.492838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:44.493278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:44.494032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:44.494459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:44.559513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-26f4f020-de12-4e12-89fe-4ac0961bd4cb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079147 Nov 24 17:55:44.560088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 284/570] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:45.571776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:45.572676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:45.579763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:45.580198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:45.580945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:45.581368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:45.648349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e231688f-e2b7-4a51-8e33-6e7b81bbc6f3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081241 Nov 24 17:55:45.648894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 287/571] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:46.659995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:46.661351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:46.668829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:46.669282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:46.670049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:46.670481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:46.734369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4693c239-56a1-4937-80be-22fd00da749d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078284 Nov 24 17:55:46.734927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 285/572] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:47.746000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:47.746843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:47.753925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:47.755626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:47.756485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:47.756917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:47.820111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1ecd0922-9067-491c-938f-500ef1024e64 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077969 Nov 24 17:55:47.820648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 288/573] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:48.831891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:48.832828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:48.840611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:48.841061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:48.841832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:48.842267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:48.911162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ed27c8e3-e172-4af4-a40f-83f50009fa9d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082793 Nov 24 17:55:48.911734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 286/574] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:49.301522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:55:49.301719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 17:55:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:55:49.922243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:49.923350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:49.930916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:49.931428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:49.932928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:49.933382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:49.999332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f60babdf-64df-4ed4-9025-770cc00ae7b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080868 Nov 24 17:55:50.000097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 289/575] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:51.010969 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:51.011821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:51.019018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:51.019520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:51.020947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:51.021387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:51.090926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1968a6a9-dc59-47d4-882a-cca3bf8aa728 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083770 Nov 24 17:55:51.091486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 287/576] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:52.102324 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:52.103822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:52.110987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:52.111431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:52.112223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:52.112653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:52.174738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-310ebf93-f54e-465d-bebb-0ce393081dda tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076174 Nov 24 17:55:52.175287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 290/577] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:52.207950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:55:52.208128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 17:55:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:55:53.186211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:53.187052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:53.194767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:53.195205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:53.195979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:53.196407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:53.260426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8cc06918-381c-4946-a515-ba54846f0744 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078022 Nov 24 17:55:53.260968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 288/578] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:54.272756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:54.273660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:54.284697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:54.285818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:54.286585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:54.287015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:54.349524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f75e7509-029d-4fe5-ab2f-b40f1cf8942d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081026 Nov 24 17:55:54.350072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 291/579] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:55.360957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:55.361889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:55.369883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:55.370330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:55.371095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:55.371536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:55.438163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f809d64d-c9e5-4069-afda-709a9263eae5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080874 Nov 24 17:55:55.438631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 289/580] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:56.449931 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:56.450863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:56.458602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:56.459053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:56.459843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:56.460276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:56.523348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1bdf9d70-ff9b-4c69-b1f6-13bef6b047c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077182 Nov 24 17:55:56.523930 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 292/581] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:57.534543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:57.535708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:57.543043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:57.543490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:57.544276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:57.544708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:57.608173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e05b333a-44fc-4a8b-baa4-6fdb341da094 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076983 Nov 24 17:55:57.608946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 290/582] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:58.621150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:58.622057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:58.629909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:58.630349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:58.631112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:58.631534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:58.706448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-95d6870a-e895-4f00-bde3-09f9f9d749e5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088611 Nov 24 17:55:58.707861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 293/583] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:55:59.719999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:55:59.720898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:55:59.728755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:59.729203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:59.729960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:55:59.730389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:55:59.794441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8b758fbc-d6bb-4ab2-8cdd-10db57072fa5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078176 Nov 24 17:55:59.794987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 291/584] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:55:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:00.805604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:00.806571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:00.813719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:00.814161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:00.814921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:00.815354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:00.881091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca001a31-4415-48bb-8730-3e1f3532c992 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079122 Nov 24 17:56:00.881566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 294/585] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:02.088038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:02.088999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:02.096165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:02.096611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:02.097373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:02.097936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:02.161458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1949b5f8-c15d-43d4-b5da-d0a29b7975a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.272807 Nov 24 17:56:02.162011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 292/586] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:03.172992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:03.173887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:03.181507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:03.181971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:03.182717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:03.183143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:03.248085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-17ef9c3d-c486-461e-bafb-a522c5306e62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078728 Nov 24 17:56:03.248628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 295/587] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:04.259786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:04.260630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:04.267847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:04.268298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:04.269059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:04.269491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:04.335825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9876a85e-8853-45e9-9893-8098afabdd1e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079802 Nov 24 17:56:04.336374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 293/588] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:05.346955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:05.348364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:05.355573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:05.356047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:05.356801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:05.357228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:05.424696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0fd7ab39-943d-44a2-adc8-e74c11c9af2f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081534 Nov 24 17:56:05.425453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 296/589] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:06.436160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:06.437004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:06.445859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:06.445859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:06.446543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:06.446974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:06.511525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5c54e8a5-336b-4c2d-8022-a34e476d3b68 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079402 Nov 24 17:56:06.512295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 294/590] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:07.523532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:07.524479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:07.531616 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:07.532070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:07.532832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:07.533264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:07.595976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c62f1c10-d815-4c66-ab5f-89067df14182 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076890 Nov 24 17:56:07.596537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 297/591] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:08.608614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:08.609459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:08.617122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:08.617573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:08.618363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:08.618801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:08.689707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6294c555-b53c-49f0-b841-6281f032d45d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084931 Nov 24 17:56:08.690275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 295/592] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:09.700421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:09.701247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:09.708528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:09.708973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:09.709723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:09.710150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:09.775843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6ae559a1-5924-42eb-9c37-cd2b9446c84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079151 Nov 24 17:56:09.776389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 298/593] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:10.787946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:10.788914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:10.796350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:10.796791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:10.797542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:10.797968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:10.859859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9f58d4fc-88a0-43b6-9a90-cea623c5471a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076464 Nov 24 17:56:10.860406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 296/594] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:11.870302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:11.871230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:11.878383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:11.879344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:11.883293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:11.883707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:11.948020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fd59c016-1d15-4c02-aebf-9448d32bd211 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081533 Nov 24 17:56:11.948561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 299/595] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:12.959740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:12.960568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:12.967884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:12.968336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:12.969220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:12.969653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:13.036786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8b3f20f8-3212-4cad-9ed1-3d252696d4a3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081096 Nov 24 17:56:13.037346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 297/596] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:14.048379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:14.049289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:14.059671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:14.060341 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:14.061499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:14.062177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:14.138945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f54af630-8bcd-4e4d-a63c-d2e0a8404569 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094419 Nov 24 17:56:14.139506 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 300/597] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:15.151202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:15.152127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:15.160398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:15.160998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:15.161772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:15.162202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:15.227690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1b6d2a34-5df4-4b1c-b090-7ce6f31baf4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080195 Nov 24 17:56:15.228246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 298/598] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:16.239433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:16.240351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:16.247425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:16.247899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:16.248646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:16.249065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:16.310844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d61cadb4-3b1a-4d48-972d-a1ed461dcae9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075243 Nov 24 17:56:16.311377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 301/599] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:17.322417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:17.323364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:17.330519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:17.330965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:17.331780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:17.332494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:17.395527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f2b58154-810d-4e15-b179-ce2403a700c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076752 Nov 24 17:56:17.396239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 299/600] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:17 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:18.406646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:18.407547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:18.414743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:18.415174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:18.415946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:18.416370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:18.482858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b8de9767-1cc9-4763-81fe-6f497dd4256d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079900 Nov 24 17:56:18.483327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 302/601] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:19.494165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:19.495077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:19.502279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:19.502725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:19.504034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:19.504508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:19.568089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a9221bc5-9e4a-4f09-a2c5-1e71a3ab26e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077621 Nov 24 17:56:19.568549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 300/602] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:20.579532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:20.580451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:20.588669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:20.589097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:20.589869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:20.590293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:20.817813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dad93a5b-5343-4744-966c-f14138cc1eeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.242012 Nov 24 17:56:20.818356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 303/603] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:21.829193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:21.830103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:21.839693 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:21.840146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:21.840922 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:21.841356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:21.908149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5c63239b-10f9-461e-b588-fea715cba6e7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082750 Nov 24 17:56:21.908692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 301/604] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:22.920258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:22.921160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:22.928755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:22.929197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:22.929961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:22.930391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:22.992886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-faf91c09-4836-47c9-a3f5-a585e3c8da4d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076518 Nov 24 17:56:22.993416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 304/605] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:24.004986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:24.005900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:24.012916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:24.013363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:24.014127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:24.014560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:24.078350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-116e96b9-d754-47cc-8333-0a441e5916bb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077903 Nov 24 17:56:24.078900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 302/606] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:25.090069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:25.090965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:25.098703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:25.099139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:25.099919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:25.100346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:25.165876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d9382937-4687-493c-9809-23de1386e445 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079454 Nov 24 17:56:25.166402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 305/607] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:26.177854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:26.178759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:26.186086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:26.186566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:26.187327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:26.187787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:26.250080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2721b5a1-aafd-4146-962f-3629c0de91c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077103 Nov 24 17:56:26.250621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 303/608] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:27.261661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:27.262424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:27.269691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:27.271356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:27.272170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:27.272598 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:27.337745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-faac4177-126f-473d-a7b9-704d48b27aa9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079901 Nov 24 17:56:27.338275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 306/609] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:28.349616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:28.350432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:28.357574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:28.358019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:28.358800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:28.359225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:28.430537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4513142b-f134-4605-be3f-3715c9b7c925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085474 Nov 24 17:56:28.431317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 304/610] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:29.444287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:29.446210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:29.453937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:29.454462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:29.455240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:29.455698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:29.524444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aef50566-414b-4366-a7ff-c6bf42050a21 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085694 Nov 24 17:56:29.524902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 307/611] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:30.535521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:30.536488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:30.543849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:30.544295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:30.545054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:30.545483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:30.611648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6ce7357c-206a-44a4-ad33-b0870154fecd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079875 Nov 24 17:56:30.612195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 305/612] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:31.623348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:31.624294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:31.632272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:31.632721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:31.633494 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:31.633926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:31.698483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9ff4c8de-6bfc-43b0-b916-1b30d30aee9e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078879 Nov 24 17:56:31.699038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 308/613] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:32.711087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:32.713082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:32.719505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:32.719976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:32.720743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:32.721169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:32.787469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-178bff6c-0db0-431b-9c77-a939196695d0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081512 Nov 24 17:56:32.788078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 306/614] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:33.798096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:33.799145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:33.806829 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:33.807264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:33.808053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:33.808475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:33.873943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5d4bc896-9905-4ace-9444-c30e557384ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079523 Nov 24 17:56:33.874467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 309/615] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:34.356401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:56:34.356584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 17:56:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:56:34.885519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:34.886424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:34.893653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:34.894100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:34.894945 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:34.895458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:34.958868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-40bda13a-728f-4ab3-a3f3-6b2bf64f3a0c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076979 Nov 24 17:56:34.959414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 307/616] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:35.970716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:35.971820 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:35.985424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:35.985873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:35.987156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:35.987590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:36.053308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-05fffc2c-e556-4498-9bf9-233be4f770d3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086936 Nov 24 17:56:36.053821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 310/617] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:37.064270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:37.065211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:37.072618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:37.073090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:37.073888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:37.074320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:37.138403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d337152f-0bff-4d54-bc20-d445f81b39fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077807 Nov 24 17:56:37.138957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 308/618] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:38.149638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:38.150565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:38.157653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:38.158093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:38.158838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:38.159263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:38.222226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca4a8736-4a1c-40ce-a0c7-67fb6c51b05e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076232 Nov 24 17:56:38.223323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 311/619] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:39.233754 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:39.234689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:39.243380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:39.243865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:39.244626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:39.245058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:39.312813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aeec78d2-6aed-4e21-9f93-da5b940c5fee tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082797 Nov 24 17:56:39.313359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 309/620] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:40.324724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:40.325630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:40.333289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:40.333731 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:40.334493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:40.334923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:40.398914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d31f3a9-32c5-4dae-93b3-4aa6d91eb7f0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077805 Nov 24 17:56:40.405712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 312/621] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:41.409463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:41.410890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:41.418636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:41.419090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:41.419882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:41.420315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:41.485603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-31e2d232-78e2-4527-9f80-2fcf7372b6fc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079809 Nov 24 17:56:41.486088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 310/622] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:42.497432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:42.498339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:42.506138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:42.506583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:42.507346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:42.507805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:42.574434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1ed3bea2-e1dc-4b37-a132-bdd81aabbbf1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080741 Nov 24 17:56:42.574928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 313/623] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:43.586553 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:43.587462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:43.594921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:43.595369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:43.596169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:43.596606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:43.660768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-41f68e13-a558-4906-82ec-b69cf6b2deb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078522 Nov 24 17:56:43.661265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 311/624] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:44.672294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:44.673174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:44.680808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:44.681246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:44.681994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:44.682418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:44.748486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5492d8ba-6a13-40d6-834d-acc9ebd8d55b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079924 Nov 24 17:56:44.749037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 314/625] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:45.760393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:45.761300 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:45.768487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:45.768940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:45.770340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:45.770781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:45.834007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9e2fa659-6189-44b4-9904-ec6c993284da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077318 Nov 24 17:56:45.834578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 312/626] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:46.845228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:46.846133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:46.854002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:46.854450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:46.855211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:46.855673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:46.919832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5f7547fa-2d51-4aae-97e6-1068b85f0d19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078354 Nov 24 17:56:46.920404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 315/627] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:47.931550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:47.932476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:47.939651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:47.940099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:47.940853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:47.941788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:48.009492 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4f5e6f3a-bc8a-42d9-9b07-206226481ef2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081558 Nov 24 17:56:48.010045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 313/628] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:49.020412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:49.021340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:49.028467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:49.028912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:49.029664 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:49.030093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:49.093096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e3cb650f-7634-4986-bb4a-38cdfb2bde38 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076901 Nov 24 17:56:49.093678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 316/629] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:50.104720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:50.105657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:50.112878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:50.113917 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:50.114785 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:50.115220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:50.178973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9ea697e7-fe7b-448c-9338-cb12501677ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077916 Nov 24 17:56:50.179525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 314/630] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:51.190029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:51.190959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:51.198116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:51.198556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:51.199314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:51.199767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:51.266096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2da9b452-980a-4531-b0f6-b84246510215 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079731 Nov 24 17:56:51.266644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 317/631] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:52.277858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:52.278762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:52.286483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:52.286924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:52.287719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:52.288155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:52.353418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6a6036b3-a7cd-433e-bde9-87e7182909e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079249 Nov 24 17:56:52.353975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 315/632] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:53.365620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:53.366516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:53.373604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:53.374044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:53.374800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:53.375225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:53.448176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-46c76381-d77c-463d-a147-a16abb3328bf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087079 Nov 24 17:56:53.449035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 318/633] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:54.463444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:54.464440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:54.471571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:54.472053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:54.472808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:54.473239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:54.536766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-54de1d3b-b41f-4ac1-8ada-a7583543e55e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080759 Nov 24 17:56:54.537320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 316/634] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:55.548111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:55.549021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:55.556180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:55.556623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:55.557382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:55.557815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:55.621364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fe80542b-5358-466d-80bd-410e47cac031 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076860 Nov 24 17:56:55.621912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 319/635] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:56.636678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:56.637606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:56.646022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:56.646465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:56.647230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:56.647692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:56.715052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a4103424-dd59-48b1-ad93-204cc1ea354a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086027 Nov 24 17:56:56.715820 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 317/636] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:57.726633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:57.727546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:57.735745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:57.736196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:57.736959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:57.737394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:57.800469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-08d9bc9a-5c87-4d20-a514-82c398248927 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078130 Nov 24 17:56:57.801011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 320/637] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:58.812367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:58.813279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:58.821508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:58.821953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:58.822712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:58.823142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:58.895538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a73e379f-2290-4793-b31c-08ba1cd0089a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086817 Nov 24 17:56:58.899118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 318/638] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:56:59.906029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:56:59.906938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:56:59.914000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:59.914435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:59.915194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:56:59.915645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:56:59.986796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-12790be3-6bbd-4357-a8f3-1715f73237cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082141 Nov 24 17:56:59.986796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 321/639] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:56:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:00.996403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:00.997280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:01.004509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:01.004957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:01.005984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:01.006451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:01.069888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-37f923d9-4095-4d28-820d-c22e476129df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077201 Nov 24 17:57:01.070446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 319/640] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:02.081022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:02.081992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:02.089052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:02.089497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:02.090249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:02.090694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:02.152927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2bccc6ed-590f-4d56-9cf7-fb20609cbc39 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075617 Nov 24 17:57:02.153474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 322/641] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:03.165137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:03.166044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:03.173454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:03.173896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:03.174656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:03.175085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:03.237611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7b5d0c1a-7076-4293-b9db-e70d4fd78028 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076880 Nov 24 17:57:03.238167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 320/642] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:57:04.248787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:04.249623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:04.257610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:04.258052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:04.258797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:04.259226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:04.322446 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c41ea1bf-323a-449e-9903-385c7c5d13be tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077363 Nov 24 17:57:04.323180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 323/643] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:05.333231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:05.334163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:05.342323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:05.342764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:05.343518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:05.343973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:05.412123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-618593a6-9ff3-4c2b-a270-45a76c4fc55f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082530 Nov 24 17:57:05.412850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 321/644] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:06.423472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:06.424395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:06.431707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:06.432156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:06.432918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:06.433343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:06.509226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cec63a14-91d9-4558-a80e-45d63ee78a9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089382 Nov 24 17:57:06.509779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 324/645] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:07.519371 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:07.520303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:07.528023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:07.528466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:07.529219 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:07.529645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:07.592445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-356b7c9c-fbcd-401e-b51d-e376e88d7b0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076363 Nov 24 17:57:07.592942 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 322/646] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:08.604150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:08.605154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:08.612291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:08.612729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:08.613491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:08.613922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:08.680521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d3ebcb37-c06c-43e1-b26c-46169841d43f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080518 Nov 24 17:57:08.680799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 325/647] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:09.691000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:09.692014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:09.699995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:09.700445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:09.701218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:09.701650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:09.764131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7ab66c69-113b-4300-b64d-1a1edc4c3334 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076756 Nov 24 17:57:09.764681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 323/648] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:10.776223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:10.777129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:10.784742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:10.785184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:10.785954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:10.786378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:10.853413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-11949d13-bb5d-48d6-a62b-1c95e2cf32c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081789 Nov 24 17:57:10.853962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 326/649] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:11.864509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:11.865419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:11.873176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:11.873618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:11.874413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:11.874834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:11.939159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-69b509d4-fc2c-4862-a7cb-6979adede19b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078285 Nov 24 17:57:11.939719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 324/650] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:12.950509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:12.951423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:12.958566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:12.959014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:12.959807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:12.960487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:13.023120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a625e67-0a4b-45da-b982-f11ff96f337c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076474 Nov 24 17:57:13.023826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 327/651] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:14.034035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:14.034938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:14.042791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:14.043235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:14.044027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:14.044460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:14.111272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-355b8359-add6-45b9-a2df-8b0e9b4afd1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080898 Nov 24 17:57:14.111852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 325/652] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:15.122200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:15.123108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:15.131154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:15.131594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:15.132783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:15.133496 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:15.208983 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-45f4c239-4609-46a9-a532-fba6df05e6ef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089121 Nov 24 17:57:15.211880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 328/653] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:16.219919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:16.220995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:16.230730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:16.231531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:16.232862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:16.233752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:16.312516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8908290f-f205-416c-8ff2-240a4b115e83 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096672 Nov 24 17:57:16.313080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 326/654] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:17.323951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:17.324859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:17.331964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:17.332408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:17.333163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:17.333596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:17.400945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e08dfdaa-307e-4d32-ad5d-5bb71ddf01c0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081266 Nov 24 17:57:17.401571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 329/655] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:17 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:18.411929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:18.412766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:18.421240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:18.421894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:18.422649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:18.423080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:18.487813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d872ffd5-dde5-4201-bee1-db1d4855cb87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079602 Nov 24 17:57:18.488363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 327/656] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:19.499712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:19.500646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:19.508401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:19.508843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:19.509601 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:19.510032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:19.572426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e6762af6-e4cb-4ab8-b25f-1ad0208f8ace tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076387 Nov 24 17:57:19.572887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 330/657] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:57:20.583049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:20.583976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:20.591379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:20.591867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:20.592635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:20.593060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:20.656280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c61819b4-5cec-4d41-9cca-b971447cf0fa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076864 Nov 24 17:57:20.656757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 328/658] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:21.668862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:21.669764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:21.676995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:21.677437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:21.678193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:21.679301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:21.742348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-69c506cf-1952-4045-82f1-c2e6a000958d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077357 Nov 24 17:57:21.742808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 331/659] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:22.753455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:22.754453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:22.762286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:22.762726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:22.763507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:22.763960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:22.831264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6c35208e-5724-4cd1-951c-b834acb9d232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081484 Nov 24 17:57:22.831853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 329/660] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:23.843093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:23.844067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:23.851899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:23.852360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:23.853162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:23.853596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:23.922079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5ff902a2-8db6-4c16-97de-b6e5ff99e828 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082859 Nov 24 17:57:23.922666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 332/661] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:24.934121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:24.935432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:24.943261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:24.943746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:24.944510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:24.945559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:25.009712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5836ec4e-8e61-42fa-84d1-2d03ad59d764 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079998 Nov 24 17:57:25.010278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 330/662] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:26.021436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:26.022337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:26.030190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:26.030637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:26.031405 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:26.031857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:26.099885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-74629c4b-5035-4bcc-b99f-a8362c35c691 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082092 Nov 24 17:57:26.100420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 333/663] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:27.111657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:27.112574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:27.119795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:27.120245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:27.121178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:27.121508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:27.185070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5c93cc47-ac6f-4c11-aea3-3fb363cb6763 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077095 Nov 24 17:57:27.185617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 331/664] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:28.196891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:28.197793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:28.204762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:28.205201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:28.205955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:28.206559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:28.271189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c54b2a54-f597-4d50-9266-55f4bfe4b750 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078560 Nov 24 17:57:28.271745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 334/665] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:29.282221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:29.283297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:29.290496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:29.290944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:29.291737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:29.292433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:29.358156 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-646368c4-7394-4553-8531-fa19055f29e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079713 Nov 24 17:57:29.358711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 332/666] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:30.369350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:30.370505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:30.378153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:30.378688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:30.379535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:30.380097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:30.447462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4bd012e3-a65d-41e5-8033-ec5248f43918 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081868 Nov 24 17:57:30.448058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 335/667] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:31.458282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:31.460934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:31.468106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:31.468560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:31.469331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:31.469768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:31.537694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9998f7d4-fe29-406b-b54a-4f1273aa4a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083155 Nov 24 17:57:31.538257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 333/668] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:32.549986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:32.550879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:32.559343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:32.559819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:32.560576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:32.561004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:32.625604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b3080b1d-7c21-4c89-a0bc-6ed82eb22f98 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079316 Nov 24 17:57:32.626150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 336/669] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:33.636422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:33.637393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:33.644473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:33.644916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:33.645672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:33.646100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:33.709517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0593ad81-3550-44e9-b775-9d1f49c910ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076777 Nov 24 17:57:33.710061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 334/670] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:34.720827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:34.721736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:34.729418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:34.729865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:34.730632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:34.731065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:34.800048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-304b7773-4cfb-47be-a4b9-42e6e7de0232 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082886 Nov 24 17:57:34.800605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 337/671] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:35.811228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:35.812351 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:35.819860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:35.820320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:35.821076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:35.821504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:35.892383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7a233146-c053-4118-b80c-5c596aeb0bde tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085412 Nov 24 17:57:35.892975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 335/672] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:36.903752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:36.904707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:36.912181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:36.912618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:36.913579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:36.914462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:36.978434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-304a671d-0b6e-43e8-8e37-db51b16404e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078439 Nov 24 17:57:36.978993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 338/673] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:57:37.989750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:37.990655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:37.999035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:37.999481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:38.000274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:38.000700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:38.067247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a246e0b3-63e6-484d-971c-4492edae62ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081205 Nov 24 17:57:38.067841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 336/674] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:39.079326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:39.080305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:39.088510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:39.089027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:39.089797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:39.090230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:39.155831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4cbd4a21-a286-49b2-a684-f3a07fccdfdd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080221 Nov 24 17:57:39.156381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 339/675] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:40.168094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:40.169005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:40.176212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:40.177821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:40.177821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:40.177821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:40.245355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-069b88d7-a356-42db-90c1-945f17947060 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081897 Nov 24 17:57:40.245921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 337/676] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:41.256967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:41.258553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:41.265656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:41.266099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:41.266908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:41.267339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:41.341777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-454673a1-46dd-4f46-a7e2-397fa4513cf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088773 Nov 24 17:57:41.342545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 340/677] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:42.353789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:42.354740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:42.362050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:42.362514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:42.363346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:42.363811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:42.398850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:57:42.400692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 17:57:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments (ip 10.222.0.64) !!! Nov 24 17:57:42.454327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-558bb65a-5573-46f3-ba75-8920042fc048 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104653 Nov 24 17:57:42.455091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 338/678] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:43.465957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:43.466854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:43.474062 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:43.474719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:43.475450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:43.476734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:43.544724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6de3f8e7-c97b-4e32-9ca7-71ee57d6d00e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082428 Nov 24 17:57:43.545275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 341/679] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:44.556979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:44.557950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:44.565217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:44.565672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:44.566535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:44.566968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:44.631507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-384b8863-1394-4253-af33-44562cfe9717 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079170 Nov 24 17:57:44.632459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 339/680] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:45.643518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:45.644352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:45.652347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:45.652799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:45.653604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:45.654041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:45.727237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0931522a-e07c-4882-92de-e93743a0488b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087567 Nov 24 17:57:45.727830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 342/681] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:46.738511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:46.739417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:46.747028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:46.747469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:46.748258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:46.748677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:46.814896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2e8b0738-b840-4a06-86bb-94857361bcb8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080040 Nov 24 17:57:46.815458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 340/682] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:47.693374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:57:47.693839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 17:57:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:57:47.826251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:47.827156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:47.834118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:47.834565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:47.836083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:47.836304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:47.900047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-15da7794-582e-49fd-bbbd-8a8057eb4c48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077701 Nov 24 17:57:47.900609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 343/683] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:48.910817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:48.912064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:48.919540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:48.921270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:48.922090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:48.922534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:48.989745 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dd48c2c7-ace9-4e4f-97bf-3c128a9ccca9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082676 Nov 24 17:57:48.990306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 341/684] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:50.000995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:50.001904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:50.009440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:50.009890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:50.010656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:50.011091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:50.079862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-564811d7-9ee0-4ff5-a63f-5f178f1ea418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082552 Nov 24 17:57:50.080417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 344/685] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:51.090043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:51.090961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:51.098642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:51.099084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:51.099874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:51.100302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:51.164953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-52e690ab-5c6b-4896-a814-b9985d0f3cd2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078545 Nov 24 17:57:51.165804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 342/686] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:57:52.176492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:52.177428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:52.185441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:52.185887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:52.186646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:52.187076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:52.249760 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a7d2fd47-810c-438c-ae77-f8796340ce2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076985 Nov 24 17:57:52.250310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 345/687] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:53.261475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:53.262384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:53.269579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:53.270017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:53.270765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:53.271189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:53.341872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1f127706-a5aa-4003-833e-ecaf6d575c8c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084728 Nov 24 17:57:53.342366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 343/688] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:54.354099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:54.354992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:54.362211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:54.362649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:54.363398 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:54.363855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:54.430854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-36172f7a-0a56-44d5-8a15-eaf9c2e8992c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081379 Nov 24 17:57:54.434595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 346/689] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:55.442160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:55.443073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:55.450283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:55.450727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:55.451489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:55.451951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:55.515097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-09c10761-04cf-40b8-977e-87455b931d8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076589 Nov 24 17:57:55.515566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 344/690] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:56.526285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:56.527194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:56.534321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:56.534762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:56.535517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:56.535973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:56.599713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d146a0d0-889b-40e4-9221-fe7c9075e30b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077187 Nov 24 17:57:56.600268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 347/691] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:57.611502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:57.612471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:57.619840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:57.620290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:57.621051 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:57.621484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:57.688959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3402f556-8a5e-4571-8ee6-1dab368cb546 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081172 Nov 24 17:57:57.689590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 345/692] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:58.700796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:58.701630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:58.708755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:58.709198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:58.710008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:58.710554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:58.777323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5c60c4f2-e9f2-43a4-97e2-3f4b8b0f2367 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080460 Nov 24 17:57:58.777874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 348/693] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:57:59.789283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:57:59.790191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:57:59.797833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:59.798274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:59.799028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:57:59.799454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:57:59.863212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5ffe572a-7174-4227-8af0-c557382087c9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078197 Nov 24 17:57:59.863795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 346/694] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:57:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:00.875280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:00.876214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:00.884026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:00.884472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:00.885234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:00.885666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:00.948392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f0b17d8d-0c9e-4898-b878-820635cbafeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076809 Nov 24 17:58:00.948937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 349/695] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:01.959774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:01.960809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:01.968129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:01.968567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:01.969318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:01.969747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:02.043777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e3b553c5-fb26-4c0a-91f0-43ae697e9cab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087713 Nov 24 17:58:02.044345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 347/696] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:03.055196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:03.056140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:03.063307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:03.063782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:03.064537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:03.064977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:03.127344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-86b6e5c9-3024-484e-95e0-b338fb695549 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075885 Nov 24 17:58:03.127916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 350/697] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:04.139180 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:04.140123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:04.147999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:04.148615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:04.149386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:04.149821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:04.212554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-79729275-b9fd-4b01-89d3-ccd4c9870f3d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077188 Nov 24 17:58:04.213116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 348/698] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:05.223767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:05.224673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:05.232474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:05.232916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:05.233661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:05.234082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:05.298069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cdf39c01-e552-4194-b323-38f10c49bf19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078152 Nov 24 17:58:05.298602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 351/699] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:06.309509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:06.310432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:06.317575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:06.318024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:06.318789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:06.319828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:06.385228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-66251e41-bac7-4042-8988-38059bfa36f8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079477 Nov 24 17:58:06.385778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 349/700] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:07.396658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:07.398245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:07.405810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:07.406392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:07.407181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:07.407639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:07.474168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d8421f96-f00e-477f-9521-0244e7dd8446 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081266 Nov 24 17:58:07.474707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 352/701] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:58:08.486284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:08.487192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:08.494513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:08.494965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:08.495764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:08.496204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:08.559111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-05bf00fc-4b87-489f-bc87-7d8df90b299a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076598 Nov 24 17:58:08.559686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 350/702] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:09.570844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:09.571795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:09.578781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:09.579220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:09.580011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:09.580438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:09.643026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e7c517c2-bf0b-460b-aac0-8f1cbf124c87 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076168 Nov 24 17:58:09.643563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 353/703] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:10.654319 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:10.655230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:10.662482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:10.663423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:10.664207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:10.664642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:10.726976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e3bd1b01-bd7c-46da-9067-763da547a332 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075813 Nov 24 17:58:10.727449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 351/704] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:11.738614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:11.739518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:11.746733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:11.747169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:11.747954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:11.748376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:11.812155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-41ab699a-5089-4ab0-9f3f-975594c1fa1a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077407 Nov 24 17:58:11.812700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 354/705] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:12.824229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:12.825159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:12.832497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:12.832939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:12.833699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:12.834131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:12.896134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f519ed5e-694f-4c8d-a77c-4febf3136b73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076402 Nov 24 17:58:12.896683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 352/706] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:13.907543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:13.908493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:13.916272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:13.916714 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:13.917710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:13.918200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:13.981838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4ec39134-106f-43dc-acab-51e72c1f0153 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078079 Nov 24 17:58:13.982379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 355/707] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:14.993730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:14.994637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:15.001819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:15.002264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:15.003016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:15.003448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:15.070824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-12ad2f76-74b9-4b3c-8deb-eb778b35bf79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080714 Nov 24 17:58:15.071389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 353/708] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:16.082331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:16.083240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:16.091156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:16.091624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:16.092395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:16.092828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:16.158378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fce0de55-5cd3-4665-85f0-506fa05c42c1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079802 Nov 24 17:58:16.158953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 356/709] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:17.170040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:17.170952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:17.178337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:17.178780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:17.179641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:17.180083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:17.245440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7d2c4c9d-5ffa-41a3-b758-be727773dff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079390 Nov 24 17:58:17.246002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 354/710] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:17 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:18.256854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:18.258238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:18.265424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:18.265865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:18.266621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:18.267049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:18.329940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-35bc0fa8-2b05-4623-b109-7e53ebd0c006 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076819 Nov 24 17:58:18.330473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 357/711] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:19.341671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:19.342610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:19.349786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:19.350228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:19.350989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:19.352011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:19.415467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7849211e-3b29-4023-b498-fba7dbc40298 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077521 Nov 24 17:58:19.416051 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 355/712] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:20.426255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:20.427058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:20.434973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:20.435412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:20.436208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:20.436640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:20.499222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-429ec32e-845d-4570-a351-33e8fa942561 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076787 Nov 24 17:58:20.499803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 358/713] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:21.511310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:21.512250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:21.519382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:21.519864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:21.520616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:21.521042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:21.583718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-47bce971-6a76-4de5-815d-1489dfb4e2e1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076891 Nov 24 17:58:21.584261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 356/714] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:22.595023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:22.595962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:22.603852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:22.604304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:22.605070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:22.605504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:22.667458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c93c8d0e-94ea-4a01-8f43-6d8ef3013a61 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076165 Nov 24 17:58:22.668214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 359/715] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:23.678859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:23.680865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:23.688064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:23.688501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:23.689252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:23.689677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:23.757242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-685d6b4a-07cf-49df-9c0d-44e10553f040 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082028 Nov 24 17:58:23.758247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 357/716] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:24.769003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:24.769903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:24.777093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:24.777534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:24.778289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:24.778719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:24.845028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6cf4be39-391e-4b7b-9f9d-bef86a8a5bad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079771 Nov 24 17:58:24.845571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 360/717] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:25.856601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:25.857518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:25.864782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:25.865226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:25.866031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:25.866470 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:25.929423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cac59b6e-0352-461d-858d-6cfb1ec5f7aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076599 Nov 24 17:58:25.929968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 358/718] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:26.940489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:26.941390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:26.949105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:26.949545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:26.950299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:26.950724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:27.013353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1c3dfbae-f22d-419d-858d-33728a64bfb5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076494 Nov 24 17:58:27.013817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 361/719] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:28.025276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:28.026209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:28.033640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:28.034084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:28.034856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:28.035320 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:28.103477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ab1e7aeb-0f36-4ea2-a0e2-5366114f8bb1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082536 Nov 24 17:58:28.104080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 359/720] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:29.114816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:29.115789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:29.123438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:29.123914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:29.124670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:29.125099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:29.188290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cc6f059e-2837-41a5-a8d9-bd7f8abc86e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077154 Nov 24 17:58:29.188843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 362/721] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:30.200681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:30.201620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:30.208760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:30.209200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:30.209951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:30.210732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:30.272701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-04c1902d-3e51-473a-be28-99eecc373f34 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075706 Nov 24 17:58:30.273481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 360/722] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:31.284473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:31.285381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:31.292971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:31.293421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:31.294185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:31.294618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:31.357657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7d44ac0c-59af-4329-aaad-caed0544ca70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076944 Nov 24 17:58:31.358203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 363/723] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:32.369964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:32.370968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:32.378277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:32.378716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:32.379478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:32.379936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:32.453592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c008e3c-ea29-4849-887b-41f438711c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088061 Nov 24 17:58:32.454160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 361/724] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:33.465877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:33.466778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:33.473953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:33.474394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:33.475150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:33.475579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:33.542005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9ef567c4-2a7e-4d72-92ec-8e3af9466c72 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080003 Nov 24 17:58:33.542547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 364/725] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:34.553610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:34.555091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:34.562299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:34.562739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:34.563493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:34.563953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:34.628477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b8222ed6-d4b1-44c0-bae9-d0b7ad7bc641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078529 Nov 24 17:58:34.629025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 362/726] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:35.640347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:35.641246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:35.649089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:35.649526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:35.650282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:35.650713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:35.713090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ab8dee4a-cd81-454b-b879-0acb27cb2f8d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076387 Nov 24 17:58:35.713556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 365/727] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:36.724379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:36.725257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:36.732965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:36.733403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:36.734151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:36.734576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:36.796497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5f87bd5b-8f03-4114-aa23-40db11195768 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076001 Nov 24 17:58:36.797038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 363/728] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:37.807887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:37.808775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:37.816084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:37.816531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:37.817291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:37.817721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:37.883687 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f1c56aad-2d21-4bb1-a51d-7e30092e85a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079621 Nov 24 17:58:37.884231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 366/729] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:38.894696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:38.895626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:38.902963 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:38.904085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:38.904902 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:38.905336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:38.969711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5b5dff3c-deb5-4bfe-aa1d-d5673d8a21dd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078790 Nov 24 17:58:38.970262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 364/730] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:39.981371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:39.982234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:39.989384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:39.989826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:39.990581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:39.991011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:40.057233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2bb977ba-037e-4161-bccd-6b7cf3dee949 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079685 Nov 24 17:58:40.057783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 367/731] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:41.068332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:41.069276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:41.077122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:41.077570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:41.078332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:41.078766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:41.144368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aeea1c66-eed5-4d7c-8efc-3ac4061fe7ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079785 Nov 24 17:58:41.144911 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 365/732] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:42.156380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:42.157278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:42.163906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 17:58:42.169560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:42.170000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:42.170750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:42.171179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:42.237953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2e104178-f21c-4855-9197-0367931af860 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085282 Nov 24 17:58:42.238500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 368/733] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:43.249657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:43.250563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:43.253703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 17:58:43.259580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:43.260054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:43.260827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:43.261260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:43.323619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-20f80f5d-f0b2-4077-928e-91296974d751 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077738 Nov 24 17:58:43.324185 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 366/734] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:44.334863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:44.336480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:44.353524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:44.353966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:44.354726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:44.355156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:44.386833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51326. Nov 24 17:58:44.420670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d3685b30-5e45-4ca8-a2c9-899f0efa8cdf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089525 Nov 24 17:58:44.421216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 369/735] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:45.432877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:45.433708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:45.452454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:45.452904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:45.453678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:45.454114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:45.484444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51340. Nov 24 17:58:45.518426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0dabdc5c-d3c7-4e18-b92f-4380e759a39d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090149 Nov 24 17:58:45.518983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 367/736] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:46.529903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:46.530876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:46.538145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:46.539172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:46.539972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:46.540402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:46.605045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c91951a7-7e9a-4bef-9d35-d6fbb668fbef tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078923 Nov 24 17:58:46.605591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 370/737] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:47.616330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:47.617687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:47.624867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:47.625307 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:47.626061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:47.626483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:47.693112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fbc5ce4e-afc4-4f4c-8b7f-32f8cf133650 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080628 Nov 24 17:58:47.693653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 368/738] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:48.704046 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:48.704867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:48.712508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:48.712946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:48.713697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:48.714133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:48.776843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d7716054-3c21-461f-bd2f-500aae3d8719 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076616 Nov 24 17:58:48.777384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 371/739] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:49.787950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:49.788844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:49.796479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:49.796917 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:49.797667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:49.798100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:49.860564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b5323843-f1dd-457e-a478-7038c812ad69 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076332 Nov 24 17:58:49.861107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 369/740] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:50.873101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:50.873995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:50.881083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:50.881516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:50.882297 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:50.882717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:50.948698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aa8a2f3d-625f-4a25-9570-e885de45c742 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079338 Nov 24 17:58:50.949229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 372/741] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:51.959948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:51.960788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:51.968468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:51.968911 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:51.969694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:51.970122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:52.033653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ca7349cb-e02d-4f26-86c0-138e40e5a3f6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077517 Nov 24 17:58:52.034196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 370/742] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:53.045345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:53.046266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:53.053391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:53.053825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:53.054574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:53.054997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:53.117529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ab826690-53be-4aca-ad95-75c7eb1cfb00 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076239 Nov 24 17:58:53.118108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 373/743] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:54.129142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:54.130050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:54.137859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:54.138305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:54.139066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:54.139499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:54.214006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-11bf09d1-c176-4b88-af51-fb573590244a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088544 Nov 24 17:58:54.214498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 371/744] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:58:55.225491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:55.226310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:55.234578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:55.235014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:55.235798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:55.236230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:55.302352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a9187327-cc4c-4e5f-8ed6-1e705f69b0d1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080732 Nov 24 17:58:55.302903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 374/745] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:56.314024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:56.314935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:56.322714 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:56.323162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:56.323947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:56.324382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:56.390809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b0ef9bb0-0369-4b8c-b3b2-e86f24190c78 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080499 Nov 24 17:58:56.391374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 372/746] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:57.403227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:57.404152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:57.411381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:57.412252 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:57.413017 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:57.413444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:57.481008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f3eb370b-82ae-48d5-a64d-8e70e795bf3e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082515 Nov 24 17:58:57.481568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 375/747] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:58.492455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:58.494640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:58.501933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:58.502374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:58.503133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:58.503558 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:58.567584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b8fddac1-6f62-4f19-a8f8-525e48ea9cd8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078869 Nov 24 17:58:58.568155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 373/748] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:58:59.579490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:58:59.580337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:58:59.587507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:59.587975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:59.588722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:58:59.589145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:58:59.655841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-63295980-d20e-43f3-8050-8c6317e2f6d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080111 Nov 24 17:58:59.656380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 376/749] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:58:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:00.668279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:00.669102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:00.676310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:00.676758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:00.677515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:00.677943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:00.742547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e1e44ee8-f3d2-4ab3-970c-84afe056cb8b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079335 Nov 24 17:59:00.747192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 374/750] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:01.758429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:01.759843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:01.766978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:01.767420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:01.768211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:01.768638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:01.830899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-67c60f7c-7480-437a-b64f-b937f395f4a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076303 Nov 24 17:59:01.831435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 377/751] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:02.842988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:02.843926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:02.851183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:02.851653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:02.852417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:02.853021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:02.917651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c0433b8a-2e53-431b-a3df-7597d5e10b3f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078404 Nov 24 17:59:02.918482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 375/752] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:03.929169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:03.929995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:03.937581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:03.938027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:03.938806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:03.939236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:04.003508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-148ad369-6f95-4be0-847a-40e3ffd4b5cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078091 Nov 24 17:59:04.004102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 378/753] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:05.014039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:05.014893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:05.022250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:05.022698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:05.023466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:05.023933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:05.091537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-85f4eb02-6ffa-43e2-a42e-364a35b7d6a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081310 Nov 24 17:59:05.092122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 376/754] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:06.102899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:06.103831 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:06.110911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:06.111354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:06.112139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:06.112568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:06.174514 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c0e06a35-ad38-4e73-b319-2924ef490351 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075378 Nov 24 17:59:06.175060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 379/755] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:07.186497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:07.187416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:07.194881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:07.195366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:07.196814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:07.197270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:07.261753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-86ee3aa6-e1ac-45ec-b9f0-e80485828d79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078924 Nov 24 17:59:07.262234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 377/756] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:08.272653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:08.273565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:08.281146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:08.281621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:08.282388 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:08.282821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:08.350091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c09a689d-2570-4171-adf2-97fe61efd532 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081180 Nov 24 17:59:08.350643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 380/757] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:09.324733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:59:09.325493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 17:59:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:59:09.361124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:09.361994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:09.369794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:09.370240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:09.370996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:09.371430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:09.436358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-222ea9fb-5eed-4bab-abda-758582c50b9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078870 Nov 24 17:59:09.437114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 378/758] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:59:10.447890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:10.448802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:10.456090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:10.456567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:10.457322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:10.457754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:10.519764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-69bd727f-515d-4491-8640-26d10c59f174 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075794 Nov 24 17:59:10.520310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 381/759] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:11.530938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:11.531868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:11.539011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:11.539456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:11.540286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:11.540715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:11.603007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0eaf6468-23d7-490c-a240-b70508bab1a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075705 Nov 24 17:59:11.603554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 379/760] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:12.224613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:59:12.225125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 17:59:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:59:12.614142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:12.615038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:12.623146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:12.623582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:12.624357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:12.624779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:12.692119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3b3d3da7-aa61-4dcf-8e29-e2d8bb77d22e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081603 Nov 24 17:59:12.692672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 382/761] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:13.703633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:13.704559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:13.711667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:13.712111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:13.713044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:13.713467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:13.780778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6e8f273e-f89f-400a-92c3-c9e88949d4c7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080841 Nov 24 17:59:13.781335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 380/762] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:14.792812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:14.794040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:14.801264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:14.801696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:14.802445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:14.802870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:14.867923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-56cbe6a5-915d-453c-af78-e7e44f7a4615 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079514 Nov 24 17:59:14.869076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 383/763] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:15.880137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:15.881050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:15.888428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:15.888882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:15.889651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:15.890086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:15.952848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ff663c26-ef33-4b41-b752-7c7fd127b428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076498 Nov 24 17:59:15.953404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 381/764] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:16.965168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:16.966122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:16.973191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:16.973675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:16.974367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:16.974790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:17.043548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-89bd8c8a-d565-40f4-9ff2-f3a3aba3895c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082596 Nov 24 17:59:17.044127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 384/765] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:18.055047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:18.056517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:18.063800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:18.064244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:18.065003 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:18.065430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:18.128135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-446fa30b-88a6-4b97-b362-24f9195cbf7e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076784 Nov 24 17:59:18.128695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 382/766] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:19.139482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:19.140414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:19.147743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:19.148190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:19.148946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:19.149371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:19.213720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-97201568-c79e-4bbe-a4e1-e397eed51bae tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078009 Nov 24 17:59:19.214271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 385/767] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:20.225208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:20.226634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:20.234962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:20.235402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:20.236206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:20.236630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:20.301987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4f3d71fa-6fd6-4420-8b49-35f08f68459e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080515 Nov 24 17:59:20.302537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 383/768] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:21.313220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:21.314215 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:21.321413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:21.321859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:21.322613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:21.323036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:21.387498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7ea5ac54-4dfa-46e2-b43e-e8e0c0f2a2ed tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077952 Nov 24 17:59:21.388276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 386/769] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:22.398238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:22.399129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:22.407336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:22.408085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:22.408841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:22.409268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:22.476939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-efe8bf31-1834-4fb6-a767-59c5d23bad79 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082378 Nov 24 17:59:22.477495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 384/770] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:23.488850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:23.489753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:23.497471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:23.497895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:23.498646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:23.499070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:23.561141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2cf3a113-99b8-4334-92bc-19849a3ab2fd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076078 Nov 24 17:59:23.561685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 387/771] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:24.572149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:24.573054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:24.580186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:24.580633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:24.581393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:24.581825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:24.645292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-39be8e9b-6cd5-4ae8-bce0-26cccced0bf3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076910 Nov 24 17:59:24.645844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 385/772] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:25.656517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:25.657459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:25.664584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:25.665721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:25.666595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:25.667027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:25.735796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d4e4447c-90c0-412a-9295-39d132311bdc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082981 Nov 24 17:59:25.736356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 388/773] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:26.748113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:26.749016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:26.756008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:26.756448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:26.757203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:26.757656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:26.822081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-652bcdb5-71cd-448f-8b13-333246cb8c9a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078295 Nov 24 17:59:26.822634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 386/774] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:27.833309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:27.834206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:27.841883 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:27.842318 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:27.843073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:27.843504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:27.906796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-86c9e399-0a4e-489e-8739-29e7d1093933 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077229 Nov 24 17:59:27.907331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 389/775] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:28.918824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:28.919787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:28.927070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:28.927518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:28.928421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:28.930203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:28.994856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ea44ed75-420e-4587-85af-6de784797748 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080327 Nov 24 17:59:28.995209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 387/776] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:30.006226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:30.007044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:30.014385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:30.014823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:30.015573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:30.016023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:30.078635 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7dacc15d-3747-4f18-8652-f675f552147d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076210 Nov 24 17:59:30.079180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 390/777] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:31.088880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:31.089716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:31.096811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:31.097258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:31.098056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:31.098488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:31.163576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-663e12c2-5d78-4268-a3c7-4e7842ccb404 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078448 Nov 24 17:59:31.164152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 388/778] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:32.175047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:32.175977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:32.183009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:32.183451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:32.184242 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:32.184672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:32.246671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fae4170c-9601-4ba7-a153-6c5027d09154 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075173 Nov 24 17:59:32.247230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 391/779] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:33.257887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:33.258736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:33.266719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:33.267172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:33.267985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:33.268422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:33.331213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0be44550-1c0e-4292-9713-d0e0843a5c40 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077128 Nov 24 17:59:33.331791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 389/780] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:34.343160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:34.344148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:34.351162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:34.351622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:34.352422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:34.352855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:34.421021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d54ef90-bed6-48aa-835c-0e0ff0d5b6e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082196 Nov 24 17:59:34.421484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 392/781] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:35.433052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:35.434158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:35.441622 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:35.442175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:35.443018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:35.443535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:35.507687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-34ba935b-8c87-423f-9d89-507c225e193d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079087 Nov 24 17:59:35.508245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 390/782] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:36.524815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:36.524815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:36.528756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:36.529200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:36.529963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:36.530399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:36.594564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6b49c581-3f76-40a9-9967-3cd3bfbfff33 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078342 Nov 24 17:59:36.595115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 393/783] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:37.607077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:37.608773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:37.617562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:37.618068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:37.618924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:37.619666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:37.686370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f31000bf-07b1-498a-a8f6-80d59a7abefe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083768 Nov 24 17:59:37.686931 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 391/784] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:38.698559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:38.699469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:38.706479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:38.706918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:38.707724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:38.708147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:38.773507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f717e1ec-0354-4483-beb4-68959ef5b32a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079353 Nov 24 17:59:38.774069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 394/785] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:39.785487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:39.786447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:39.794664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:39.795116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:39.795915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:39.796398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:39.863579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7b6dd928-f1f6-43b2-80a1-c99d4bc2ad62 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081812 Nov 24 17:59:39.864158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 392/786] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:40.047337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:40.047958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:40.054727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:40.055171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:40.055963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:40.056394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:40.270719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lazy-loading 'services' on Instance uuid 16db57ca-063c-485b-a4a7-4d92fcfbde5a {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 17:59:40.416180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c90a27c5-9103-4019-b4e5-43f93cddb47b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "DELETE /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a/os-volume_attachments/f48f97c0-444c-46e1-a665-05a1dde84797" status: 202 len: 0 microversion: 2.1 time: 0.372629 Nov 24 17:59:40.417944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 395/787] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Nov 24 17:59:40 2021] DELETE /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a/os-volume_attachments/f48f97c0-444c-46e1-a665-05a1dde84797 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 17:59:40.877926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:40.878952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:40.887517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:40.887991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:40.888766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:40.889201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:40.956975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-16052622-08d1-4012-8e81-9f31becd6548 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085215 Nov 24 17:59:40.957546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 393/788] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:41.969807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:41.970939 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:41.980257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:41.980708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:41.981599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:41.982047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:42.047354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c7f8104e-6c3b-4fea-9485-8d8b79777eb2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082589 Nov 24 17:59:42.048232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 396/789] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:43.059981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:43.060905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:43.068029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:43.068477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:43.069245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:43.069666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:43.135404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4671d076-1896-4098-bb14-e91086566a73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079727 Nov 24 17:59:43.135943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 394/790] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:44.147116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:44.148199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:44.156733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:44.157176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:44.157939 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:44.158366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:44.229017 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9b9b1b61-ba3a-437d-9d14-af2a2b2ae4ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085953 Nov 24 17:59:44.229534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 397/791] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:45.240082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:45.241159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:45.248334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:45.248773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:45.249531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:45.249965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:45.316820 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3d07ed13-3226-420f-9044-f476497e1fec tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080356 Nov 24 17:59:45.317389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 395/792] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:46.328696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:46.329604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:46.336725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:46.337166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:46.337928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:46.338368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:46.406535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-de203b68-c14c-4ac7-bc3c-a41cd4bc8cba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082148 Nov 24 17:59:46.407257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 398/793] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:47.418012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:47.419297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:47.427759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:47.428433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:47.429244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:47.429612 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:47.506808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c55fe188-79b2-4008-b76a-cc61015d22da tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092704 Nov 24 17:59:47.507388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 396/794] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:48.518239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:48.519237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:48.526769 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:48.527209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:48.528052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:48.528489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:48.602728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-720869b8-68e9-41ca-bbb9-33a6d4c37702 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088136 Nov 24 17:59:48.603307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 399/795] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:49.614770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:49.616954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:49.623725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:49.624364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:49.625136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:49.625571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:49.689395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c7ec6eba-0924-4b72-af40-673a57deda63 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078355 Nov 24 17:59:49.690120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 397/796] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:50.700207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:50.701631 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:50.709334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:50.709771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:50.710520 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:50.710945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:50.781676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2d0f754f-4476-4ba1-928e-2f93fb300a95 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082033 Nov 24 17:59:50.781676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 400/797] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:51.790144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:51.791053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:51.798434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:51.798883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:51.799678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:51.800113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:51.862650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b915f843-b00e-4127-b000-ecdba4620985 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076455 Nov 24 17:59:51.863220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 398/798] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:52.874137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:52.875056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:52.882095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:52.882542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:52.883305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:52.883765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:52.946244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e10d0df-84b2-450e-8897-3c31717f41fe tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076092 Nov 24 17:59:52.946793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 401/799] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:53.957637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:53.958506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:53.965758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:53.966209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:53.967544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:53.968019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:54.030882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-97d78913-2673-442d-8ad6-941648f41dba tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077099 Nov 24 17:59:54.031434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 399/800] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:54.373900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 17:59:54.374408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 17:59:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 17:59:55.042206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:55.043182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:55.051172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:55.051622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:55.052397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:55.052858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:55.119212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d62cf759-9d4d-4ceb-abf9-5908fde46243 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080697 Nov 24 17:59:55.119814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 402/801] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 17:59:56.130977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:56.131938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:56.139318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:56.139891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:56.140653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:56.141084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:56.207776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-11c52908-f6ec-47a0-bc7f-f36086d9282d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080423 Nov 24 17:59:56.208323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 400/802] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:57.219377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:57.220311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:57.227464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:57.227941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:57.228708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:57.229158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:57.292102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca44bd6a-4597-4837-be78-e5624f740233 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076885 Nov 24 17:59:57.292643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 403/803] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:58.304604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:58.305519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:58.313463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:58.313914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:58.314685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:58.315118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:58.378418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a53b1379-6182-4bb2-b0aa-6a0937a3c342 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077553 Nov 24 17:59:58.378973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 401/804] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 17:59:59.390449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 17:59:59.391451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 17:59:59.398543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:59.399049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:59.399849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 17:59:59.400269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 17:59:59.467420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e581b62e-e133-4001-945a-c6520cd96e6d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081162 Nov 24 17:59:59.467999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 404/805] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 17:59:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:00.477901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:00.478941 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:00.486483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:00.486932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:00.487727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:00.488166 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:00.554930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-de56805f-b1d2-40d6-a6fb-2a75dadbeead tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080709 Nov 24 18:00:00.555493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 402/806] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:01.567700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:01.568596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:01.576323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:01.576790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:01.577547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:01.577973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:01.641503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-05900c12-3197-4678-8795-9c9a75250ca2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077458 Nov 24 18:00:01.642048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 405/807] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:02.652758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:02.653667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:02.660967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:02.661411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:02.662174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:02.662612 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:02.725725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90c80188-2204-486a-bee7-8f854dc859e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076777 Nov 24 18:00:02.728458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 403/808] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:03.737605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:03.738688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:03.745858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:03.746303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:03.747067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:03.748474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:03.813681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-897ad9b5-a170-4826-9f7d-4690537a2309 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079741 Nov 24 18:00:03.814230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 406/809] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:04.825084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:04.827206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:04.838399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:04.838844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:04.839620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:04.840061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:05.070926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-346c8f0c-f431-46eb-b07c-8dd7f9219e73 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249560 Nov 24 18:00:05.071504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 404/810] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:06.082079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:06.083002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:06.090146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:06.090582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:06.092489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:06.092960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:06.156572 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7fff7729-415a-4472-9515-97589e33b788 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078207 Nov 24 18:00:06.157117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 407/811] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:07.167647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:07.170053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:07.177344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:07.177792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:07.178565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:07.179001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:07.242331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ce6a9599-532a-4720-a17c-d26024e89a74 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078472 Nov 24 18:00:07.242868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 405/812] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:08.253863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:08.254767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:08.261870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:08.262313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:08.263696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:08.264135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:08.327162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-50c4633a-e16a-426d-8d05-09bdcf11b74b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076850 Nov 24 18:00:08.327854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 408/813] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:09.337882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:09.338794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:09.346669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:09.347116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:09.347899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:09.348331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:09.413081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-393d13bc-facf-4bbf-b95f-99fd230995aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078837 Nov 24 18:00:09.413619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 406/814] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:10.425144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:10.426064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:10.434668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:10.435719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:10.436493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:10.436916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:10.499401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d033429c-04f3-4722-8686-d85ef52b07a6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077958 Nov 24 18:00:10.499967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 409/815] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:11.510012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:11.510920 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:11.518690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:11.519141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:11.520023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:11.520464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:11.588205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-689bc60b-990b-4bbc-9c2d-78cfadeb8ff6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081799 Nov 24 18:00:11.588748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 407/816] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:12.599438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:12.600362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:12.608621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:12.609061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:12.609813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:12.610246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:12.678897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5317a70a-8599-47bd-bc73-895bf608ca52 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083086 Nov 24 18:00:12.679429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 410/817] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:13.690306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:13.691208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:13.698344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:13.698781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:13.699545 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:13.699996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:13.764244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d226ac3f-c625-4bd3-a782-43af752382b6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077630 Nov 24 18:00:13.764791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 408/818] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:14.776200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:14.777109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:14.784967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:14.785413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:14.786184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:14.786614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:14.856099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd17ee5e-060f-4235-8940-1e6f0bf3f1e3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084458 Nov 24 18:00:14.857431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 411/819] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:15.875877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:15.876792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:15.884087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:15.884535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:15.885301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:15.885740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:15.949294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d9eb2cc5-73d1-4a39-9b5f-be881797c9d7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077780 Nov 24 18:00:15.949871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 409/820] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:16.961550 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:16.962296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:16.970743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:16.971184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:16.971971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:16.972400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:17.035713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aab286cd-3ea7-4062-af14-9cbc17de1ca6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078071 Nov 24 18:00:17.036271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 412/821] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:18.047172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:18.049747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:18.065184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:18.065184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:18.065184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:18.065184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:18.125706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9709744a-640c-4a3c-8b88-9f453b7d89ab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083178 Nov 24 18:00:18.126279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 410/822] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:19.136894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:19.138423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:19.147041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:19.147483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:19.148277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:19.148711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:19.213885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-42c52e23-b568-4eb0-8e80-c97e6ad5f5a5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080611 Nov 24 18:00:19.214435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 413/823] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:20.225784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:20.226765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:20.235146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:20.235628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:20.236633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:20.236865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:20.302064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-baad3168-d1c6-442c-8e34-296fd1dc87aa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080070 Nov 24 18:00:20.302619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 411/824] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:21.314360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:21.315300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:21.322296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:21.322733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:21.323495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:21.323942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:21.393666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e1f9b06b-4949-4542-880a-2041a7c90925 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084139 Nov 24 18:00:21.397420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 414/825] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:22.405949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:22.407068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:22.414551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:22.415005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:22.415918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:22.416245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:22.484908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-be4a8abf-fa94-4871-b3c8-0662c2cf649c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083223 Nov 24 18:00:22.485488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 412/826] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:23.495970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:23.496898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:23.504545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:23.504985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:23.505737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:23.506165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:23.571552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2d128fb5-2734-4892-adad-7384ebc86704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079375 Nov 24 18:00:23.572410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 415/827] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:24.582844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:24.583779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:24.590916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:24.591361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:24.592815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:24.593253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:24.665760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6244e3dd-2ffd-45e4-8106-61afc2424562 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086559 Nov 24 18:00:24.666316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 413/828] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:25.677312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:25.678214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:25.685257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:25.686256 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:25.687471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:25.687945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:25.754044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-17979163-e161-4ad9-adde-8c40e1630766 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080444 Nov 24 18:00:25.754599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 416/829] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:26.766075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:26.767064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:26.774195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:26.774708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:26.775539 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:26.776062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:26.846432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3a0d50d5-ebae-4606-9e4a-85e1080ca9e6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084929 Nov 24 18:00:26.846978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 414/830] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:27.858410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:27.859326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:27.866480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:27.866924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:27.867712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:27.868148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:27.932384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a32eba14-f149-4912-8dc8-185f4a7d9d41 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078356 Nov 24 18:00:27.932942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 417/831] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:28.943023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:28.943988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:28.952032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:28.952740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:28.953526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:28.954137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:29.038319 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-71e4b8b9-8f6d-41b3-a59d-8bb6e0b0d0d9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098786 Nov 24 18:00:29.038880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 415/832] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:30.052590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:30.053913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:30.061154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:30.061596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:30.062359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:30.062805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:30.130473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-10e4ce3d-2577-4b51-ba11-699ef03c34e2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081775 Nov 24 18:00:30.131060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 418/833] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:30 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:31.141854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:31.142788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:31.149856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:31.150307 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:31.151072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:31.151509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:31.215369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-924973a6-6058-4ae5-917a-7ef30151186d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077428 Nov 24 18:00:31.215967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 416/834] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:32.226114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:32.227045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:32.234350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:32.234805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:32.235567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:32.236019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:32.300355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c4ae87e0-e761-478c-a9ee-161c935097c5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077987 Nov 24 18:00:32.300908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 419/835] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:33.310695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:33.312181 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:33.319501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:33.319978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:33.320738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:33.321165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:33.391756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-05544c73-2aa8-4225-8827-8b989bf00f4f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080043 Nov 24 18:00:33.391756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 417/836] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:34.400168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:34.402165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:34.412253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:34.413136 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:34.414162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:34.414818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:34.487777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca9bfa3d-705f-4c14-bbce-741b18004a05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092936 Nov 24 18:00:34.488552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 420/837] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:35.498569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:35.500749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:35.507937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:35.508387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:35.509133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:35.509563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:35.578500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-64cbcfec-ac0f-4aa8-8aaa-3c72aedd38c4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083176 Nov 24 18:00:35.579136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 418/838] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:36.589502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:36.590399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:36.597612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:36.598058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:36.600445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:36.600445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:36.662966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a42fdb6b-0aed-4401-941e-5fa28b47722c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077205 Nov 24 18:00:36.663526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 421/839] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:37.674443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:37.675398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:37.682690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:37.683317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:37.684172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:37.684827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:37.748672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0d99ff5d-7c5f-4e97-aac2-e10ea69c993a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078039 Nov 24 18:00:37.749839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 419/840] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:38.760515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:38.761495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:38.769211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:38.769659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:38.770429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:38.770870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:38.838010 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c2777ddb-d4f0-439c-99dd-354ff5cb629b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081229 Nov 24 18:00:38.838655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 422/841] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:39.849493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:39.850459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:39.857555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:39.858071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:39.859432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:39.859894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:39.923400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d8b70e3e-5992-418f-b242-1f09d9605573 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077636 Nov 24 18:00:39.923987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 420/842] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:40.934567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:40.935555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:40.943235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:40.943717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:40.944481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:40.944912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:41.008066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aad506f1-ac4e-4376-b540-f6504d2cfee6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077181 Nov 24 18:00:41.008627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 423/843] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:42.019825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:42.020732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:42.027972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:42.028422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:42.029186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:42.029624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:42.092894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-37478a65-34fa-464e-b741-b4c98a7f88a2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076699 Nov 24 18:00:42.093506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 421/844] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:43.103622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:43.104570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:43.113689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:43.114143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:43.114899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:43.115327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:43.179963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5817e67e-7441-4e51-bc47-54ea1ac9b94a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080091 Nov 24 18:00:43.180680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 424/845] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:44.191521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:44.191521 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:44.198780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:44.199224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:44.200022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:44.200450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:44.266897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-24244eec-d579-48c1-b6f0-c60a81990d82 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080453 Nov 24 18:00:44.267455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 422/846] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:45.278383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:45.279282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:45.286634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:45.287079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:45.287886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:45.288319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:45.352085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3b2aeb1e-5424-48dc-9691-a27e1dccab48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077525 Nov 24 18:00:45.352644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 425/847] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:46.363465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:46.364387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:46.371630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:46.372091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:46.372848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:46.373276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:46.437687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e7b21607-23bc-4855-867c-2826fbe6516f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077965 Nov 24 18:00:46.439733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 423/848] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:00:47.448764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:47.449667 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:47.456953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:47.457375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:47.458151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:47.458718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:47.525564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a30b89cc-6ed6-4bc6-9b5c-8be49028994b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080493 Nov 24 18:00:47.526129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 426/849] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:48.537147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:48.538087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:48.545885 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:48.546049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:48.546797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:48.547229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:48.610243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1cf87e81-1211-40d5-b541-ad00e4e0ebc9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076907 Nov 24 18:00:48.610796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 424/850] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:49.621458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:49.622366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:49.630790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:49.631361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:49.632155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:49.632607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:49.700379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-45f767bb-fe08-4330-ad41-b9ee24ec55c2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082553 Nov 24 18:00:49.700865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 427/851] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:50.712304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:50.713208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:50.721107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:50.721556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:50.722317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:50.722759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:50.795015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7efc62f1-f117-4605-97df-3c671cd4bcab tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086172 Nov 24 18:00:50.796062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 425/852] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:51.807429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:51.808349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:51.816145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:51.816584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:51.817342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:51.817766 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:51.881229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b8342e92-033a-4b01-b5e9-2b3b8aa33ab1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077577 Nov 24 18:00:51.881792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 428/853] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:52.892659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:52.893580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:52.900812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:52.901262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:52.902034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:52.902469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:52.969386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-67758424-fdaa-407e-bc76-47758fc432ca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080657 Nov 24 18:00:52.969946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 426/854] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:53.980656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:53.981571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:53.988730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:53.989178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:53.989940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:53.990403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:54.052685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bf6c0b79-3e92-461b-a471-4a9917fd8c59 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075803 Nov 24 18:00:54.053232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 429/855] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:55.064465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:55.065399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:55.072606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:55.073049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:55.073807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:55.074256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:55.136688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-60594adb-99df-4786-a957-4f417ae45418 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076391 Nov 24 18:00:55.137230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 427/856] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:56.148864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:56.149798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:56.157464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:56.157897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:56.158646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:56.159109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:56.225996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-186e4775-2ef0-4f2f-99fd-314e4253fc0a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080869 Nov 24 18:00:56.226543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 430/857] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:57.238272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:57.239168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:57.246276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:57.246721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:57.247475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:57.248053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:57.313358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d9bd5dd1-1152-4b7d-b924-6929ae969430 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078829 Nov 24 18:00:57.313901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 428/858] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:58.324779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:58.325686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:58.333533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:58.333977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:58.334739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:58.335170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:58.399315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5231eafe-3763-498e-aa95-ce4c905c1f05 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078235 Nov 24 18:00:58.399876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 431/859] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:00:59.410527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:00:59.411436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:00:59.418737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:59.419443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:59.420959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:00:59.421587 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:00:59.490196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ea6a06b4-3284-450d-82d0-7187184e8bfd tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083348 Nov 24 18:00:59.490758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 429/860] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:00:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:00.501592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:00.502430 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:00.509567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:00.510013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:00.510773 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:00.511205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:00.573844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-53bfc90f-1dec-4b00-ab71-26466367ce06 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076123 Nov 24 18:01:00.574385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 432/861] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:01.586157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:01.587067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:01.594377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:01.594822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:01.595583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:01.596046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:01.661584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ef7798b-f31e-42d3-a2ff-514e8b55afcf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079164 Nov 24 18:01:01.662124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 430/862] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:02.446039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:01:02.446197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:01:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:01:02.743618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:02.744527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:02.751877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:02.752319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:02.753088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:02.753521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:02.819734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd554b29-5947-4f00-8840-318d2ad250f2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148387 Nov 24 18:01:02.823447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 433/863] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:03.831299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:01:03.832258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:03.839463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:03.840008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:03.840766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:03.841199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:03.899586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:01:04.915294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53002. Nov 24 18:01:04.987797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-345ecc01-b14c-4f81-82d7-f82d3203adaa tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action" status: 200 len: 108613 microversion: 2.1 time: 1.160310 Nov 24 18:01:04.988465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 431/864] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:01:03 2021] POST /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437/action => generated 108613 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:01:16.399301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:16.400843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:16.409057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:16.409504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:16.410265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:16.410691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:16.478536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2f8a298f-e735-4b8c-83a7-3063eab0148f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082908 Nov 24 18:01:16.479088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 434/865] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:17.490810 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:17.491828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:17.499628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:17.500823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:17.501616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:17.502057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:17.566512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cd6b3789-476f-4376-90d8-d0b160847092 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079760 Nov 24 18:01:17.567064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 432/866] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:18.577327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:18.578838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:18.586621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:18.587060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:18.587834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:18.588259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:18.652555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ab870830-2d3a-4a3b-8bbe-1a106a3204f1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078879 Nov 24 18:01:18.653103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 435/867] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:19.663765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:19.664669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:19.673834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:19.674279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:19.675057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:19.675486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:19.743081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1c8535ef-a307-45ed-b3ac-31e80a17f18e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083026 Nov 24 18:01:19.743823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 433/868] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:01:20.754432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:20.755334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:20.762713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:20.763156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:20.763952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:20.764381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:20.828204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-54351366-376a-4b04-a098-1004640cc74d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077540 Nov 24 18:01:20.829319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 436/869] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:21.840111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:21.841023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:21.848967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:21.849413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:21.850174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:21.850604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:21.914655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d9f0c1b6-0c14-4ef5-aad1-f45f7335bfe9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078272 Nov 24 18:01:21.915207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 434/870] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:22.925807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:22.926697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:22.933821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:22.934257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:22.935008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:22.935432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:23.002170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f8a63d59-f358-4dbf-a5b2-44c6bdc35853 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080015 Nov 24 18:01:23.002726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 437/871] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:24.013872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:24.014853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:24.022127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:24.022575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:24.023346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:24.023843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:24.086727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e08ddc2c-1a1d-48be-94ee-9a353d161b7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076641 Nov 24 18:01:24.087285 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 435/872] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:25.099096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:25.100022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:25.107094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:25.107533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:25.108321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:25.108747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:25.172828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-665ff89d-d1ca-40d5-8ec1-04de585888b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076854 Nov 24 18:01:25.176321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 438/873] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:26.183849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:26.184771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:26.193058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:26.193503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:26.194260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:26.194683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:26.258762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6e908456-ace2-41e5-9d41-92826fc04868 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078633 Nov 24 18:01:26.262852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 436/874] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:27.270502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:27.271428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:27.278580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:27.279017 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:27.279793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:27.280220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:27.343078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c61b8149-c304-4f8b-8ddd-cf078106ef7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076201 Nov 24 18:01:27.343700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 439/875] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:28.354996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:28.355925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:28.364215 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:28.364663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:28.365431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:28.365863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:28.433381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-13d5339d-d505-4ee0-9770-7ac5e951ce72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082055 Nov 24 18:01:28.434114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 437/876] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:29.444791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:29.445700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:29.452798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:29.453544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:29.454003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:29.454429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:29.517301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f41f2434-bf5d-4691-90b5-383b361f1971 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076347 Nov 24 18:01:29.517857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 440/877] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:30.528537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:30.529441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:30.537391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:30.537830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:30.538592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:30.539023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:30.606406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ba5c226c-a540-4d4d-bc75-cb9824c0ec76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081601 Nov 24 18:01:30.606963 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 438/878] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:31.616827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:31.617752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:31.625885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:31.626338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:31.627094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:31.627519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:31.695916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f7eb13a2-4244-41cc-8b5e-c9b79fd025da tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082813 Nov 24 18:01:31.696463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 441/879] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:32.706334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:32.707272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:32.714391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:32.714835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:32.715630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:32.716091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:32.778872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dbff742b-b443-4e2d-9bd1-601f86ad7a02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076470 Nov 24 18:01:32.779360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 439/880] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:33.789805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:33.790709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:33.798752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:33.799188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:33.799969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:33.800394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:33.862409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-94bcb64d-1bec-4466-952e-ad44fef87099 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076199 Nov 24 18:01:33.862975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 442/881] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:34.875358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:34.875358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:34.882567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:34.883226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:34.884042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:34.884470 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:34.952041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-970e1e47-6a4a-4b0f-9571-019b707d34e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082123 Nov 24 18:01:34.955716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 440/882] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:35.963871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:35.965454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:35.973620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:35.974070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:35.974871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:35.975306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:36.041708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cc86167a-5fd8-47eb-a169-c015d6303cc4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081396 Nov 24 18:01:36.042603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 443/883] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:37.058363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:37.058363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:37.064078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:37.064558 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:37.065516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:37.066182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:37.141358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b172c10b-8ac1-4d67-afaf-828a85df3b5c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091388 Nov 24 18:01:37.142073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 441/884] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:38.152609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:38.153505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:38.161265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:38.161703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:38.162462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:38.162884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:38.226327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d3d49047-8a88-4f02-a2f4-2ee588a3cde1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077386 Nov 24 18:01:38.226886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 444/885] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:01:39.237869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:39.239481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:39.246855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:39.247441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:39.248252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:39.248685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:39.312933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c3956faa-919f-44e1-995e-dfa9d8023385 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078667 Nov 24 18:01:39.313490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 442/886] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:40.324340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:40.325249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:40.333267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:40.333696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:40.334451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:40.334880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:40.401835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8991e931-19d7-4926-a11f-2b1ea520e29a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081309 Nov 24 18:01:40.405737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 445/887] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:41.413298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:41.414276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:41.424430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:41.425399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:41.426880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:41.427718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:41.495910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-608f7726-9390-445c-ace1-dd7b771f0379 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086368 Nov 24 18:01:41.496467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 443/888] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:42.507824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:42.508721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:42.516965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:42.517412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:42.518176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:42.518600 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:42.586007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-099b9ba4-6024-469a-9544-f392437b6a15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081813 Nov 24 18:01:42.589938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 446/889] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:43.597415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:43.598450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:43.605749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:43.606201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:43.606974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:43.607410 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:43.675971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d3f0e991-12a0-4024-be31-8d1580cdcf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082693 Nov 24 18:01:43.679725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 444/890] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:44.684755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:01:44.688786 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:44.689664 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:44.696942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:44.697390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:44.698152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:44.698581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:44.763094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d20752ea-b56d-4100-824c-cda0637ff293 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079561 Nov 24 18:01:44.763855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 447/891] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:45.774131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:45.775148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:45.783165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:45.783707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:45.784474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:45.784903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:45.854498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e0465ac1-6d28-41bf-91e3-8ab639bb50c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084165 Nov 24 18:01:45.855054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 445/892] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:46.866036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:46.866925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:46.884032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:46.884472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:46.885248 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:46.885657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:46.949416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53472. Nov 24 18:01:46.965626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a4a393dd-a8b4-49a7-b7e0-c72fa6b43903 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103158 Nov 24 18:01:46.966486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 448/893] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:47.977555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:47.978481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:47.986357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:47.986805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:47.987575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:47.988043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:48.053253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2f8d4ef5-0d2a-47a6-b5ec-50594849fd06 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079279 Nov 24 18:01:48.053807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 446/894] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:49.064947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:49.065847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:49.073228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:49.073668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:49.074424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:49.074852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:49.286285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e5c2666f-97a6-40af-a851-78eddd1ee21a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.225636 Nov 24 18:01:49.290120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 449/895] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:50.298768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:50.299769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:50.307241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:50.307730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:50.308492 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:50.308919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:50.377471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-73cb89b1-3a67-4739-b777-9e0660b9f22f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083688 Nov 24 18:01:50.378383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 447/896] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:51.389006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:51.393376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:51.401077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:51.401647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:51.402416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:51.403050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:51.473498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-894982d3-b05b-4fce-88fb-0cc4cff9999a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088373 Nov 24 18:01:51.474394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 450/897] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:52.484977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:52.485904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:52.492998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:52.493483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:52.494260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:52.494957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:52.570993 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1e57c569-cbf6-48fb-80fc-f8efbb3d48dc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089750 Nov 24 18:01:52.574853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 448/898] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:53.582824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:53.583842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:53.591764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:53.592413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:53.594041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:53.594287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:53.660282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fd9b0a4a-c242-45cf-8692-03363ade032b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081230 Nov 24 18:01:53.661061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 451/899] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:54.672973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:54.673879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:54.681097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:54.681812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:54.682906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:54.683532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:54.751305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8c1882da-b477-4b39-a511-3c25688ba9f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083250 Nov 24 18:01:54.751982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 449/900] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:55.762039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:55.762926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:55.769960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:55.770397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:55.771181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:55.771619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:55.837203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-24f9a92e-c204-4376-80df-469a66331d49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078813 Nov 24 18:01:55.837942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 452/901] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:56.849525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:56.850447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:56.857414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:56.857852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:56.861250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:56.861697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:56.928174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a3e55a15-e76f-4069-b922-8609a160e11c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082261 Nov 24 18:01:56.932247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 450/902] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:57.940302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:57.941228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:57.948186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:57.948621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:57.949374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:57.949821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:58.013181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a835a4c-8a79-4d7c-bee4-951e74989594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077453 Nov 24 18:01:58.014039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 453/903] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:01:59.025579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:01:59.026767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:01:59.034758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:59.035277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:59.036099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:01:59.036534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:01:59.111184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3490b04c-eb66-4a55-b07b-bd7c9a45c4e9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089598 Nov 24 18:01:59.112374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 451/904] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:01:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:00.122431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:00.124182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:00.140246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:00.140683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:00.141450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:00.141875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:00.206818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dc57102c-3018-4156-8755-74e9f445c542 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088353 Nov 24 18:02:00.207976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 454/905] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:02:01.218109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:01.219110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:01.232068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:01.232068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:01.232068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:01.232068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:01.295499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1a2217f6-bade-462c-872f-bbeee405808c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081074 Nov 24 18:02:01.296836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 452/906] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:02.307579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:02.308552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:02.316768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:02.317268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:02.318040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:02.318469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:02.388927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-400ccebb-9a71-4a8e-81d3-c71945d2110a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085107 Nov 24 18:02:02.394489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 455/907] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:03.403809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:03.406780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:03.418824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:03.419919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:03.422598 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:03.423288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:03.501096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-22f4eeea-9f71-44bc-8bc9-53ff934533fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102660 Nov 24 18:02:03.501865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 453/908] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:04.512550 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:04.514049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:04.521985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:04.522426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:04.523376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:04.524145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:04.589754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-640c8a1c-f65b-44f2-9952-50d7a5770299 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080856 Nov 24 18:02:04.590555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 456/909] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:05.602230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:05.603329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:05.611879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:05.612333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:05.613114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:05.613888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:05.680258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-236c98e4-aa42-4e35-9760-09955665e945 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082584 Nov 24 18:02:05.684280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 454/910] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:02:06.691774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:06.692678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:06.699685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:06.700131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:06.700891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:06.701315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:06.765231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cfab1e45-5bb9-4a2f-b5b9-74fd18382791 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077089 Nov 24 18:02:06.767786 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 457/911] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:07.776692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:07.777604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:07.785464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:07.785917 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:07.786696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:07.787132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:07.876506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-14998b23-0152-4453-8c08-296f59cfaf51 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103570 Nov 24 18:02:07.877073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 455/912] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:08.888448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:08.889481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:08.897189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:08.897627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:08.898391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:08.898815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:08.966145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cf259f61-25d7-4f27-bcbb-a202e3b97ebd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081363 Nov 24 18:02:08.966929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 458/913] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:09.978238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:09.979145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:09.988805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:09.989214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:09.990392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:09.991168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:10.066629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9f8e6c52-170d-4778-bff1-ab4b1b175f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091788 Nov 24 18:02:10.067437 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 456/914] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:11.079624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:11.080551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:11.087660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:11.088107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:11.088874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:11.089305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:11.159312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-adac3fc8-4bab-4a28-9ba8-b02986a0774d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084773 Nov 24 18:02:11.160140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 459/915] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:12.170528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:12.172753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:12.179949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:12.180387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:12.181155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:12.181578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:12.255570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f0d92746-ce5e-416e-8383-98515522f6b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089151 Nov 24 18:02:12.256407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 457/916] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:13.266308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:13.267266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:13.274234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:13.274678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:13.275441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:13.275909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:13.341823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e0e09aba-b270-4463-916d-473a244fa587 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079342 Nov 24 18:02:13.343107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 460/917] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:14.353379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:14.354463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:14.362217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:14.362769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:14.363551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:14.364107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:14.444206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c2d6fb50-b6ad-49e6-960e-dc8105b3fccf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094604 Nov 24 18:02:14.448571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 458/918] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:15.456666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:15.457587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:15.464925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:15.465371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:15.466148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:15.466723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:15.536798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b6723425-4ed1-4e6c-8543-3f60e7c83ba0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084925 Nov 24 18:02:15.537718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 461/919] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:16.550574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:16.551484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:16.558679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:16.559129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:16.559925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:16.560361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:16.624326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c5d13214-473e-401b-aaf3-521d543cf409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079669 Nov 24 18:02:16.625082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 459/920] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:17.635713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:17.636614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:17.643878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:17.644329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:17.645088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:17.645518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:17.708960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a7ea80cd-372d-45fa-858d-c7a242ffd12f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077012 Nov 24 18:02:17.709656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 462/921] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:18.720423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:18.721318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:18.728235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:18.728677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:18.729435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:18.729861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:18.799301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c7df5627-cf1c-4b0f-a8de-6f7422465a3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082949 Nov 24 18:02:18.799895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 460/922] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:19.812574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:19.813533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:19.820688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:19.821130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:19.821888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:19.822313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:19.890014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-af0713e6-102d-4d78-b77b-f77e72a810a8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082383 Nov 24 18:02:19.890564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 463/923] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:20.900483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:20.901392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:20.908617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:20.909113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:20.909884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:20.910309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:20.979076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c5f407e-2f17-4377-96cd-c8735e7a1afb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082233 Nov 24 18:02:20.979646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 461/924] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:21.990576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:21.991505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:21.999541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:22.000190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:22.000967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:22.001397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:22.066603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c6034618-8a20-43f1-b4fa-e58a3d9ad3e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079677 Nov 24 18:02:22.067080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 464/925] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:23.078266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:23.079177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:23.086359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:23.086811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:23.087588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:23.088046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:23.151936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2181fb52-5af7-4c74-b3c3-5f71dec850d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077866 Nov 24 18:02:23.152423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 462/926] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:24.162937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:24.163870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:24.171910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:24.172356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:24.173124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:24.173558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:24.244866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0ea1f4ad-7f38-4b58-bb98-824cc355a97b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085207 Nov 24 18:02:24.245838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 465/927] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:25.258101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:25.259251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:25.266899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:25.267339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:25.268136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:25.268560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:25.333131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e589c7a1-1b8f-45a3-b490-4f9988bab3e2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078837 Nov 24 18:02:25.333777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 463/928] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:26.344579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:26.345558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:26.352774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:26.353216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:26.353972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:26.354399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:26.418497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cbb87a99-30c3-41b8-9493-94ba8620c0bb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077776 Nov 24 18:02:26.420585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 466/929] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:27.431344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:27.432267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:27.439806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:27.440370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:27.441058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:27.441487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:27.515910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-909482ba-e3a0-487d-a435-d34b5d238423 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081764 Nov 24 18:02:27.515910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 464/930] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:28.520015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:28.520937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:28.528102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:28.528547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:28.529838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:28.530276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:28.597685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-95149a04-a2d6-41ed-83a8-68169c73d3fa tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081402 Nov 24 18:02:28.598462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 467/931] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:29.343024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:02:29.343642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:02:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:02:29.609111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:29.609969 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:29.617229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:29.617675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:29.618439 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:29.618870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:29.683727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bf3afcaa-7195-47f6-8412-2f49447a3d54 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078455 Nov 24 18:02:29.687442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 465/932] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:30.694498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:30.695449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:30.702693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:30.703229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:30.704005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:30.704439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:30.767895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-94473a9d-b500-4a73-be73-52a52e2041c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077039 Nov 24 18:02:30.768649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 468/933] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:31.779541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:31.780608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:31.787905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:31.788352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:31.789114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:31.789542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:31.853597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c98d637c-bd0b-4bd8-88a9-380bf4ef82be tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078021 Nov 24 18:02:31.854158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 466/934] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:32.243163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:02:32.243693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:02:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:02:32.865788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:32.866678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:32.874926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:32.875372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:32.876162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:32.876592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:32.941557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f448e692-e999-4c0e-be21-68975df0e52b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079386 Nov 24 18:02:32.942113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 469/935] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:33.953141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:33.954081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:33.961293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:33.961741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:33.962505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:33.962943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:34.026629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a7f2c8a7-3375-4804-ae29-2096535e7599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077684 Nov 24 18:02:34.027186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 467/936] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:35.037999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:35.038897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:35.046833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:35.047276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:35.048068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:35.048499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:35.113736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-82dd67a7-ec98-4b4e-8c0e-3255fb4fa0d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079356 Nov 24 18:02:35.114527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 470/937] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:36.124659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:36.125571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:36.132641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:36.133085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:36.133844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:36.134279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:36.200529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0cbb0878-6643-4962-a805-a8474160e055 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080066 Nov 24 18:02:36.201283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 468/938] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:37.211923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:37.212824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:37.220578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:37.221020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:37.221771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:37.222196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:37.287850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8806dc60-1863-495c-9e40-b84a25c3468d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079494 Nov 24 18:02:37.288390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 471/939] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:38.299634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:38.300549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:38.307811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:38.308255 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:38.309036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:38.309464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:38.377170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-474d595c-edff-41ea-9e6e-f0299743eb7c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082700 Nov 24 18:02:38.378041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 469/940] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:39.388035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:39.388965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:39.396390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:39.396834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:39.397594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:39.398014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:39.462120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-633b1e57-7c1c-4c30-b622-3aa7511dd8b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077831 Nov 24 18:02:39.462677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 472/941] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:40.473721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:40.474632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:40.481735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:40.482239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:40.483267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:40.483831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:40.547846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4c9111ab-fbf0-48d3-8ad6-b531d27c7220 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077728 Nov 24 18:02:40.548335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 470/942] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:41.558041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:41.559022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:41.566377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:41.566859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:41.567650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:41.568088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:41.631234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dccee500-7b23-4d83-8005-68eeb8acf824 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076838 Nov 24 18:02:41.631997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 473/943] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:42.642598 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:42.643649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:42.650775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:42.651227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:42.652029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:42.652471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:42.716007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c06f69d2-b701-46a2-80f5-c4aa27ddb104 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077233 Nov 24 18:02:42.716568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 471/944] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:43.727419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:43.728348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:43.736024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:43.736453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:43.737218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:43.737649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:43.801226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1a6e3de8-7194-4b66-b561-0b968622a4d9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077470 Nov 24 18:02:43.801773 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 474/945] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:44.813062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:44.813995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:44.821678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:44.822147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:44.822909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:44.823339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:44.895508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-495bd39d-ef95-4855-8839-546df7249562 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082763 Nov 24 18:02:44.895508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 472/946] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:02:45.902434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:45.903238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:45.911966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:45.912623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:45.913768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:45.914411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:46.002553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-01988398-339e-44a8-a700-43c85fd4d536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103695 Nov 24 18:02:46.003119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 475/947] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:47.014610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:47.015569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:47.022888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:47.023339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:47.024141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:47.024583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:47.092680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ce90152c-a761-4cd4-8e9f-efaa27081fd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082378 Nov 24 18:02:47.093227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 473/948] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:47.712925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:02:47.713432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:02:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:02:48.103995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:48.104892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:48.112531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:48.112968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:48.113725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:48.114149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:48.189227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-68cfcf45-3676-4cda-ba6b-70351f7526b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081403 Nov 24 18:02:48.189227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 476/949] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:49.193468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:49.194367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:49.201729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:49.202173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:49.203591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:49.204041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:49.268315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-94f628d9-d682-4972-8725-b02099db4d34 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078941 Nov 24 18:02:49.272143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 474/950] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:50.279824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:50.281273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:50.288626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:50.289063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:50.289814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:50.290526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:50.354658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8fcc973c-d92c-40f0-83ed-d95ad51cd6f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078545 Nov 24 18:02:50.355401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 477/951] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:02:51.366149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:51.367056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:51.374428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:51.375490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:51.376280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:51.376710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:51.446227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8c66e4d7-4a19-4335-b232-061f5b7d8143 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083813 Nov 24 18:02:51.446780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 475/952] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:52.457055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:52.457966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:52.465279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:52.465729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:52.466491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:52.466923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:52.535232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-72701858-8f9a-40ef-876b-b684fc065b93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081874 Nov 24 18:02:52.535811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 478/953] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:53.547379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:53.548302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:53.555473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:53.555939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:53.556688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:53.557113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:53.620767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-16b9f141-fa2c-499a-9846-c0a35dea0384 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077934 Nov 24 18:02:53.621313 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 476/954] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:54.632780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:54.633609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:54.641369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:54.641369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:54.641369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:54.641369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:54.711555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4452b592-977f-4305-abfb-3c53ff5b571c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082648 Nov 24 18:02:54.712130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 479/955] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:55.724154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:55.724991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:55.732193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:55.732639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:55.733440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:55.733924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:55.798487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0d4565ae-bcd4-4f28-b3d4-a5e70163bdae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078113 Nov 24 18:02:55.799040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 477/956] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:56.809795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:56.810704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:56.817798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:56.818239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:56.818997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:56.819426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:56.881499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dc7ce707-e4c3-4eb2-a98e-73dd326ee97d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075440 Nov 24 18:02:56.882048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 480/957] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:57.893791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:57.895349 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:57.902544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:57.903024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:57.903829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:57.904267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:57.970698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aab28c5b-a9e8-4201-8736-28dcb5e1be4b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081504 Nov 24 18:02:57.971261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 478/958] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:02:58.982277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:02:58.983186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:02:58.990321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:58.990766 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:58.991529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:02:58.991982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:02:59.055361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d0232538-a894-4f65-bd43-00dc87fd5551 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076833 Nov 24 18:02:59.055940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 481/959] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:02:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:00.067173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:00.068104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:00.076343 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:00.076799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:00.078573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:00.079008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:00.145965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8fe5646b-5349-457d-a696-6fdad9a0a665 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082704 Nov 24 18:03:00.146504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 479/960] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:01.158546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:01.159442 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:01.166508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:01.166947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:01.167724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:01.168147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:01.236290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6989a6a2-e778-453b-a267-100bc8e3c279 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082568 Nov 24 18:03:01.236835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 482/961] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:02.247615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:02.248515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:02.256223 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:02.256662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:02.257414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:02.257844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:02.321999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7e9d7690-a352-401c-a040-a3626894c10a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078079 Nov 24 18:03:02.322536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 480/962] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:03.333367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:03.334271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:03.341425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:03.341863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:03.342676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:03.343121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:03.405232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-368fecba-5cd7-4c4d-bde0-6bda9847bb3a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075519 Nov 24 18:03:03.405873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 483/963] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:04.416707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:04.417605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:04.425847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:04.426285 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:04.427035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:04.427461 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:04.491086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-411828dc-48f8-4ab9-941a-daabd2472fa3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078102 Nov 24 18:03:04.491655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 481/964] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:05.502909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:05.503834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:05.511726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:05.512170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:05.512933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:05.513362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:05.575358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e2bb0263-f851-44c0-9c48-40002a69d527 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076822 Nov 24 18:03:05.575925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 484/965] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:06.586751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:06.587706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:06.595422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:06.595892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:06.596650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:06.597087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:06.660483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7dc1b6d6-1595-4292-84a7-5453381ae75e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077464 Nov 24 18:03:06.661042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 482/966] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:07.672284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:07.673220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:07.680380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:07.680824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:07.681615 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:07.682047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:07.744234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-75ac9443-ed98-41f0-ad68-4cabf41955bf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075964 Nov 24 18:03:07.744734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 485/967] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:08.755757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:08.756584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:08.763877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:08.765011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:08.765828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:08.766261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:08.845749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ba2c186d-236a-43fe-a560-ee4a8ae18841 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093767 Nov 24 18:03:08.846310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 483/968] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:09.857316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:09.858867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:09.866327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:09.866949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:09.867749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:09.868176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:09.945513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3d1998d9-1a27-4049-b3e7-c9d31b2e3036 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091987 Nov 24 18:03:09.946050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 486/969] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:03:10.957493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:10.958394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:10.965580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:10.966024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:10.966783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:10.967218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:11.030646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dc09dabb-de06-436b-bd15-fac610bb9a31 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076775 Nov 24 18:03:11.031191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 484/970] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:12.041850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:12.042751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:12.050770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:12.051210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:12.052008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:12.052435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:12.114020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-eb5cb513-cdcd-46f4-8429-4ed927798972 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075876 Nov 24 18:03:12.114554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 487/971] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:03:13.126323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:13.127264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:13.134762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:13.135201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:13.136012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:13.136470 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:13.200697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c56e7538-9456-4ec1-8904-c651414f6b1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078968 Nov 24 18:03:13.201250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 485/972] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:14.212339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:14.213170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:14.221001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:14.221445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:14.222209 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:14.222635 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:14.287334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-58491ca2-9bde-44df-9c6d-bea6e7875da7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078778 Nov 24 18:03:14.287905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 488/973] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:14.391750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:03:14.391925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:03:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:03:15.299583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:15.300509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:15.307651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:15.308102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:15.308865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:15.309299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:15.371355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-43425b62-7055-492f-a4e8-81084d50597c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076415 Nov 24 18:03:15.371936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 486/974] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:16.383313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:16.384244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:16.392115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:16.392563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:16.393325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:16.393759 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:16.457080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-29b104d1-0320-4b3a-965f-946c686134e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077562 Nov 24 18:03:16.457632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 489/975] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:17.468685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:17.469605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:17.477283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:17.477734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:17.478510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:17.478946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:17.545214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90cf56a4-2cc0-4575-8356-94ff396f4bff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080106 Nov 24 18:03:17.546291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 487/976] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:18.557848 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:18.558757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:18.566442 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:18.566886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:18.567675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:18.568108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:18.640841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a7d5f53b-9ba1-4822-b02e-46b44c8c46a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086865 Nov 24 18:03:18.641389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 490/977] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:19.651693 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:19.652599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:19.660195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:19.660634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:19.661389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:19.661818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:19.724439 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-26c7abef-1e81-44cc-b358-630a5b8a3535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076507 Nov 24 18:03:19.724990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 488/978] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:20.736780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:20.737591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:20.744670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:20.745106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:20.745852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:20.746275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:20.814638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-886bffde-4a17-456c-bea2-7a116433c142 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082654 Nov 24 18:03:20.815183 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 491/979] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:21.826138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:21.827827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:21.835049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:21.835498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:21.836292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:21.836727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:21.901448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cd5bf843-3b22-4fbe-8a46-2d4679aeca0c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078992 Nov 24 18:03:21.902002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 489/980] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:22.913053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:22.913963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:22.921455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:22.921903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:22.922667 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:22.923103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:22.991100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8100ec73-c973-43d8-bcab-40439e2e65f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081728 Nov 24 18:03:22.991665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 492/981] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:24.002627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:24.003454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:24.010648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:24.011090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:24.011868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:24.012295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:24.074469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6d7e57c3-ab2f-4215-b925-be0f9ab3b421 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075683 Nov 24 18:03:24.075015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 490/982] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:25.086205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:25.087234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:25.094309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:25.094784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:25.095547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:25.096004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:25.157673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d5a0e0b7-c46f-4490-b340-28f6a01d6bd4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075273 Nov 24 18:03:25.158215 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 493/983] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:26.169100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:26.170187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:26.178032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:26.178481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:26.179250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:26.179717 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:26.247303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1e292f9f-8c8b-42d9-8c7a-6706252e272e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082021 Nov 24 18:03:26.247909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 491/984] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:27.258175 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:27.259074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:27.266400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:27.266843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:27.267611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:27.268047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:27.333118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-eb83f276-6826-447f-b0ff-278ca86f5cb8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078677 Nov 24 18:03:27.333654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 494/985] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:28.345212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:28.346151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:28.353704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:28.354172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:28.354927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:28.355358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:28.419818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d0e43b88-5ea1-4878-b917-27876139aa88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079139 Nov 24 18:03:28.422193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 492/986] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:29.432796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:29.433621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:29.441672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:29.442120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:29.442885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:29.443317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:29.507295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d12d0f66-b40c-40f9-aea4-d68fa1ae7936 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078397 Nov 24 18:03:29.507870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 495/987] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:30.519448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:30.520399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:30.527587 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:30.528117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:30.528871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:30.529359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:30.593430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-654d73bb-cd82-4cd4-a470-54f01ec794f8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077550 Nov 24 18:03:30.593884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 493/988] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:03:31.603843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:31.604757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:31.612144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:31.612584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:31.613342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:31.613770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:31.676945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6a1d5192-9010-4209-93db-62783719e730 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076852 Nov 24 18:03:31.677410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 496/989] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:32.688403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:32.689308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:32.696569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:32.696954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:32.697712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:32.698145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:32.761216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-42ebabf9-068b-4379-96a0-b0e031bd5895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076716 Nov 24 18:03:32.761765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 494/990] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:33.773101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:33.774001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:33.781344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:33.781782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:33.782532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:33.782959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:33.846333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e0eb15e-7ef4-4a5c-a6ae-11692bbbefa9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076916 Nov 24 18:03:33.846795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 497/991] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:34.857860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:34.858709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:34.866066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:34.866517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:34.867286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:34.867759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:34.936494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bc7b53e8-a5ae-4d03-9aaa-e06b35728ed1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081799 Nov 24 18:03:34.936984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 495/992] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:35.947618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:35.948569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:35.956246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:35.956688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:35.957440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:35.957868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:36.023077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-45ccd194-361d-4cca-be33-c36f04a94c4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079191 Nov 24 18:03:36.023638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 498/993] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:37.034667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:37.035623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:37.042716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:37.043161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:37.043962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:37.044395 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:37.108141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aa224a1c-6ca2-4f92-9b52-0af84ceab145 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076473 Nov 24 18:03:37.108616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 496/994] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:03:38.119136 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:38.120063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:38.127134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:38.127571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:38.128354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:38.128781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:38.192042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-400251c5-a1e0-4b48-90c2-321cacb22b64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076472 Nov 24 18:03:38.192530 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 499/995] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:39.202862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:39.203898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:39.211062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:39.211505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:39.212294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:39.212724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:39.275932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e6594396-dd01-43f0-a647-7b5d544b7071 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076783 Nov 24 18:03:39.276465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 497/996] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:40.287668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:40.288573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:40.296019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:40.296464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:40.297230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:40.297665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:40.365340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26226d29-1f5b-43ec-956b-663ff4f882c4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081386 Nov 24 18:03:40.365812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 500/997] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:41.376846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:41.377749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:41.385182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:41.385628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:41.386421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:41.386854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:41.450233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-da943370-4050-4c5a-99d8-f488ded87c72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077141 Nov 24 18:03:41.451322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 498/998] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:42.462228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:42.463129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:42.471013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:42.471487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:42.472274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:42.472705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:42.534487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2f31eb78-4962-413a-b05e-813d86f99565 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075985 Nov 24 18:03:42.535028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 501/999] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:43.547063 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:43.548004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:43.555152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:43.555619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:43.556400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:43.556839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:43.622459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-27a9050a-a15e-4e20-9c83-e1543aa6c1e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080533 Nov 24 18:03:43.623512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 499/1000] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:44.634066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:44.634966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:44.642646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:44.643087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:44.645072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:44.645510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:44.718196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0760fcc2-8e1a-40e2-aa9f-6732193c2d8d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087611 Nov 24 18:03:44.718663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 502/1001] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:45.726883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:03:45.730243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:45.731144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:45.739061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:45.739509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:45.740310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:45.740748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:45.803803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-eee5c84f-17fa-45e7-a8aa-ae7bbf2220b0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078135 Nov 24 18:03:45.804358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 500/1002] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:46.815929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:46.816864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:46.824303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:46.824751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:46.825541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:46.826231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:46.889829 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d19d171b-1948-45c3-960e-9899148bd006 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077410 Nov 24 18:03:46.890377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 503/1003] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:47.901262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:47.902200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:47.920004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:47.920447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:47.921200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:47.921631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:47.953291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 54846. Nov 24 18:03:47.986495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-78998f6d-4433-4ddd-97ad-6d769b299300 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088990 Nov 24 18:03:47.987047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 501/1004] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:48.998830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:48.999761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:49.006820 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:49.007254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:49.008042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:49.008469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:49.071439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2a2b36de-3991-4f6a-b176-2325a1bf2456 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076956 Nov 24 18:03:49.072016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 504/1005] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:50.082111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:50.083123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:50.090145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:50.090594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:50.092045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:50.092488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:50.155804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-77b222f0-9d4e-475e-aeeb-98f03a5db290 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077369 Nov 24 18:03:50.156362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 502/1006] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:51.166328 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:51.167263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:51.175141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:51.175581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:51.176369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:51.176799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:51.239249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e438552a-4916-431c-ac23-cc6ec71d6b84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076688 Nov 24 18:03:51.239820 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 505/1007] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:52.250774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:52.251758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:52.258827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:52.259277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:52.260074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:52.260510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:52.327520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-43140e38-1ddf-458d-b498-924649e81993 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081056 Nov 24 18:03:52.328113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 503/1008] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:53.338482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:53.339380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:53.348896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:53.349339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:53.350094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:53.350516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:53.419058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ddc1e8d6-5508-4172-b9da-01cf843508cb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084243 Nov 24 18:03:53.420516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 506/1009] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:54.430580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:54.432138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:54.440570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:54.441012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:54.441779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:54.442288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:54.505960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ebd7d327-dc1d-4dc4-b1a5-db56ac74dc88 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079020 Nov 24 18:03:54.506504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 504/1010] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:55.516452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:55.517357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:55.524313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:55.524755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:55.525515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:55.525944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:55.590114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5d4ba4f4-6f35-4865-bd00-c36cdb641191 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077522 Nov 24 18:03:55.590657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 507/1011] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:56.602140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:56.603049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:56.611114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:56.611561 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:56.612364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:56.612796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:56.676872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d965cd00-32d5-4c20-afe2-9698c6f18b39 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078447 Nov 24 18:03:56.677435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 505/1012] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:57.688591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:57.689535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:57.696848 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:57.697299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:57.698069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:57.698698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:57.762168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-664ca3a6-d785-4d40-9d57-e925b490eb5e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077822 Nov 24 18:03:57.762740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 508/1013] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:58.773946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:58.774856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:58.782136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:58.782584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:58.783353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:58.783818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:58.847706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-02121dd9-6c09-43e0-a05c-a0d494282862 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077420 Nov 24 18:03:58.848258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 506/1014] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:03:59.858042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:03:59.858975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:03:59.866163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:59.866604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:59.867368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:03:59.867825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:03:59.931717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-94a645c1-871f-4bbd-a065-d99ee5ea45e0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077352 Nov 24 18:03:59.932271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 509/1015] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:03:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:00.943719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:00.944546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:00.952462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:00.952915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:00.953690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:00.954124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:01.021653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fdd079f7-729c-4dd6-bcea-75df6b649408 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081785 Nov 24 18:04:01.022491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 507/1016] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:02.033377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:02.034275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:02.041367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:02.041806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:02.042634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:02.043067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:02.110255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d0618b20-d8ea-4d44-938d-937628161b68 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080796 Nov 24 18:04:02.110808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 510/1017] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:03.120949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:03.121854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:03.129485 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:03.129928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:03.130690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:03.131117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:03.197100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-136d1abe-fe33-4354-8de7-a66350d62ae5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079883 Nov 24 18:04:03.197655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 508/1018] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:04.208941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:04.209785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:04.217016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:04.217463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:04.218225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:04.218658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:04.282175 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-95adf098-3114-4523-a1d8-2e99e013153b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076974 Nov 24 18:04:04.282726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 511/1019] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:05.293386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:05.294533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:05.302013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:05.302496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:05.303275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:05.303738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:05.367267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2df39e5b-8cd0-4ac1-9ff9-37a783176a1d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077594 Nov 24 18:04:05.367854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 509/1020] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:06.379095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:06.380028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:06.387291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:06.387880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:06.388601 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:06.389036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:06.454125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-382aef23-d933-4794-9860-24e029f3007a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078569 Nov 24 18:04:06.454913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 512/1021] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:07.465766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:07.466728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:07.474013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:07.474450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:07.475199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:07.475648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:07.539080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8275c936-a808-4d6d-b3ea-9f83de6277fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077216 Nov 24 18:04:07.539650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 510/1022] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:08.550586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:08.551515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:08.558571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:08.559009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:08.560346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:08.560772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:08.623551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4a6774eb-1978-49d0-b772-aa67eb2ac1b1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076432 Nov 24 18:04:08.624240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 513/1023] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:09.634316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:09.635217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:09.642700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:09.643141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:09.643929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:09.644356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:09.866520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-03ff0037-65c8-47a9-87c3-57e0efe08a89 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236062 Nov 24 18:04:09.867063 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 511/1024] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:10.878447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:10.879350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:10.886298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:10.886736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:10.887499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:10.887960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:10.953845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9fc18e45-93b7-47ee-b2f0-b8aed004aed9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079112 Nov 24 18:04:10.954390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 514/1025] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:11.965418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:11.966522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:11.973665 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:11.973925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:11.974680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:11.975100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:12.038872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-638ea940-ed7e-4de8-8a24-ed8d3ac80205 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077208 Nov 24 18:04:12.039414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 512/1026] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:13.050423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:13.051355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:13.058411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:13.058860 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:13.059639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:13.060076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:13.123453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a6e162cc-ffe6-45ee-8bea-d988b1a0a3a3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076695 Nov 24 18:04:13.124078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 515/1027] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:14.133912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:14.134815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:14.142256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:14.142712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:14.143479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:14.143938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:14.207029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-06532f37-cd20-4ec8-b4b5-00de19e64efc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076780 Nov 24 18:04:14.207563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 513/1028] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:15.218672 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:15.219582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:15.227107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:15.227697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:15.228534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:15.228961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:15.292224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-175bee54-0a08-4e16-b43f-dde82bb62394 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077912 Nov 24 18:04:15.292955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 516/1029] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:16.305220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:16.306121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:16.313782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:16.314875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:16.315756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:16.316251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:16.384456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4676264b-16f9-47cd-b4e3-fa9eac326b57 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083611 Nov 24 18:04:16.385229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 514/1030] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:04:17.396160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:17.397212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:17.404474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:17.404919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:17.405691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:17.406122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:17.469091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-258997b7-5790-4036-9b2a-cdaedc5d8671 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077092 Nov 24 18:04:17.469679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 517/1031] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:18.480209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:18.481112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:18.490001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:18.490606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:18.491966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:18.492610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:18.556350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-707cee98-f735-4a8b-b0a6-2723b083d9ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080021 Nov 24 18:04:18.560216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 515/1032] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:19.566649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:19.567551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:19.574655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:19.575094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:19.575877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:19.576307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:19.642523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-28ad0f6b-ec7e-46b6-8c50-ebaf71b0d2b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079536 Nov 24 18:04:19.643081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 518/1033] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:20.653883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:20.654782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:20.662523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:20.662970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:20.663752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:20.664184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:20.727866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-47dd3c77-37ea-42ff-801e-6d6901d52d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077605 Nov 24 18:04:20.728340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 516/1034] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:21.739351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:21.740275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:21.747489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:21.747959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:21.748719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:21.749147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:21.813524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8d8ae187-da06-4130-9d53-daf01b6e5411 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078145 Nov 24 18:04:21.814751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 519/1035] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:22.462972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:04:22.463447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:04:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:04:22.825757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:22.826664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:22.834552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:22.834992 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:22.835786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:22.836216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:22.898508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90d5b0ae-3448-47ac-b960-bbd532ce47f5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076479 Nov 24 18:04:22.899052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 517/1036] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:23.909824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:23.910743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:23.918332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:23.918782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:23.919548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:23.920009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:23.982911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8addc537-7cb5-40bb-8909-2fae6deb7517 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076832 Nov 24 18:04:23.983460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 520/1037] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:24.994651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:24.995473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:25.002570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:25.003009 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:25.003793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:25.004221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:25.069773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-55dee5f7-5092-4038-a909-a02f53de2e8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079415 Nov 24 18:04:25.070303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 518/1038] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:26.081161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:26.082059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:26.090300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:26.090739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:26.091492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:26.091944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:26.155749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f6c25f37-5085-4411-9ea2-89469d2316ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078299 Nov 24 18:04:26.156294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 521/1039] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:27.167610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:27.168527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:27.175983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:27.176424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:27.177177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:27.177606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:27.239350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b7305dfc-a4aa-4a7d-900c-95b069adfb85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075610 Nov 24 18:04:27.239924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 519/1040] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:04:28.250648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:28.251579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:28.259561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:28.260025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:28.260779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:28.261206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:28.326599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-97e4a87b-617b-43b6-8dda-92df1a9fb2c8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079712 Nov 24 18:04:28.327138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 522/1041] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:29.337852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:29.338749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:29.346043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:29.346483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:29.347236 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:29.347698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:29.410416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ad88d36f-8504-45c3-beac-41e75659ef43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076550 Nov 24 18:04:29.410956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 520/1042] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:30.422210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:30.423149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:30.431561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:30.432096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:30.432856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:30.433284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:30.498093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e8203b24-b60f-4763-819b-64d7e108cbbc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079884 Nov 24 18:04:30.498633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 523/1043] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:31.509252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:31.510092 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:31.517406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:31.517862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:31.518634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:31.519070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:31.585028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-40db8781-0aec-4fbd-a125-ffb45c46b861 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079595 Nov 24 18:04:31.585567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 521/1044] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:32.596629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:32.597536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:32.605191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:32.605629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:32.606387 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:32.606819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:32.669148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c545dfce-5c1e-42fd-af64-6cc91ebaa44b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076322 Nov 24 18:04:32.669696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 524/1045] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:33.680250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:33.681062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:33.688293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:33.688727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:33.689514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:33.689934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:33.752703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d69c684d-ba34-4a7f-a76e-9e4390113bcb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076324 Nov 24 18:04:33.753303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 522/1046] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:34.763932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:34.764758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:34.772536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:34.772738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:34.773493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:34.773957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:34.838530 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b0c253d8-3e35-4b95-a0ff-7cbcc66df269 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078453 Nov 24 18:04:34.839083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 525/1047] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:35.850568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:35.851389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:35.858749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:35.859192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:35.859977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:35.860402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:35.924590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a4f008af-e8de-44e3-8610-312930a98459 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078417 Nov 24 18:04:35.925121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 523/1048] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:36.936173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:36.937001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:36.945029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:36.945470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:36.946226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:36.946658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:37.013485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-06827a9c-0621-4acf-a990-bce644cb9444 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081057 Nov 24 18:04:37.014028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 526/1049] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:38.025724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:38.026628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:38.034046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:38.034496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:38.035371 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:38.035856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:38.098726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cc5c8fe9-5fd7-4e66-8023-d0f7a95687ea tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077703 Nov 24 18:04:38.099262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 524/1050] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:39.110249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:39.111079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:39.118319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:39.118767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:39.119529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:39.119988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:39.182750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4845ecbc-dbf9-475c-b2da-a640d43df316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076294 Nov 24 18:04:39.183274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 527/1051] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:40.195078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:40.196027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:40.204029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:40.204473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:40.205236 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:40.205659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:40.272427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6e94af90-a482-4de3-9db9-c7f933cc1a45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081547 Nov 24 18:04:40.272961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 525/1052] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:41.283913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:41.284941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:41.291957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:41.292399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:41.293163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:41.293592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:41.356339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ccca31a3-480e-4826-ab83-70e60c88e0ee tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076252 Nov 24 18:04:41.356900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 528/1053] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:42.368115 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:42.369040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:42.376601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:42.377048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:42.377863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:42.378298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:42.442612 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c409247a-4689-43ee-bbb5-21383c3bc248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078431 Nov 24 18:04:42.443745 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 526/1054] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:43.455668 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:43.456600 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:43.464419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:43.464856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:43.465610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:43.466029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:43.527791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7fdd19f1-db27-4128-95f4-b97751ffd6cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076501 Nov 24 18:04:43.528333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 529/1055] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:44.538967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:44.540383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:44.547969 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:44.548413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:44.549172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:44.549602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:44.612930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7c43a75d-fb10-4b70-9529-2bf4d39b14e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077736 Nov 24 18:04:44.613474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 527/1056] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:45.625025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:45.625878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:45.633146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:45.633587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:45.634344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:45.634773 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:45.700850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2b23133c-4966-4177-ac1f-77cd2a0eec72 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079619 Nov 24 18:04:45.701392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 530/1057] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:46.712582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:46.713422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:46.720546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:46.721001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:46.721761 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:46.722193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:46.784710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-644352d5-902b-4802-b27c-12bd831b0fa8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076370 Nov 24 18:04:46.785246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 528/1058] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:47.793961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 24 18:04:47.797501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:47.798406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:47.806304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:47.806749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:47.807513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:47.807979 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:47.871909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-63491ba6-74e2-4984-accf-b9bad54112d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078840 Nov 24 18:04:47.872453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 531/1059] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:48.884169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:48.885000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:48.892235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:48.892681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:48.893439 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:48.893871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:48.959620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a38c455b-78c3-40ec-af85-59f8d60d227d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080077 Nov 24 18:04:48.960167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 529/1060] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:49.971101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:49.972030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:49.989503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:49.990617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:49.991426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:49.991892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:50.038429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 55534. Nov 24 18:04:50.055786 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7905bd52-95c1-4135-8949-e65cac8e7314 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088376 Nov 24 18:04:50.056332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 532/1061] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:51.066448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:51.067294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:51.075212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:51.075688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:51.076458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:51.076897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:51.139045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8cc731ab-68d8-4c9d-8e3c-95c75878561c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076437 Nov 24 18:04:51.139590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 530/1062] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:52.150182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:52.151164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:52.158367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:52.158755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:52.159514 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:52.159977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:52.222652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d0204d1-3ef8-4076-9a1e-ee3ed75bce3f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076213 Nov 24 18:04:52.223202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 533/1063] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:53.234099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:53.235005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:53.242104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:53.242553 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:53.243308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:53.243767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:53.306361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2e901eb3-989a-4b85-a734-a772de5fd33b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076009 Nov 24 18:04:53.306910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 531/1064] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:54.317484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:54.318393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:54.325452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:54.325895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:54.326653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:54.327085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:54.393712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-10a0f37d-3625-47a4-9e7e-5e33e271c059 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079900 Nov 24 18:04:54.394270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 534/1065] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:55.405433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:55.406332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:55.414353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:55.414801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:55.415559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:55.416008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:55.478697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d850a127-6f39-49f2-a81e-44fd589e051e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076951 Nov 24 18:04:55.479245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 532/1066] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:56.489968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:56.491516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:56.498526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:56.498962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:56.499739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:56.500196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:56.564313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fca20673-2b30-4bb9-ad92-fb8ebf19043c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077911 Nov 24 18:04:56.564778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 535/1067] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:57.574858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:57.579788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:57.582990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:57.583428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:57.584759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:57.585228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:57.651057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-02bccc22-9b40-4930-bc00-e6f4e817eb45 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079924 Nov 24 18:04:57.651520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 533/1068] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:04:58.662227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:58.663261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:58.670847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:58.671290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:58.672103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:58.672686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:58.736019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-704ab7cd-5fbe-4a5c-aaff-6ade02dc26b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077432 Nov 24 18:04:58.736571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 536/1069] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:04:59.748971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:04:59.749922 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:04:59.757906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:59.758527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:59.759500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:04:59.759966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:04:59.824002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8f1d81f2-15cd-402f-82c3-f3c0a4f01ea0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079571 Nov 24 18:04:59.824547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 534/1070] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:04:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:00.835310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:00.837431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:00.845412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:00.845861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:00.846622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:00.847050 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:00.909910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f5f417e1-2dbf-4bd8-8228-f926f0d4b1bc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078382 Nov 24 18:05:00.910464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 537/1071] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:01.921186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:01.922081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:01.929446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:01.929927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:01.931176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:01.931932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:01.995129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2b3465b4-b487-478b-a468-e104147ff4ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077839 Nov 24 18:05:01.995629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 535/1072] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:03.006552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:03.007482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:03.014660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:03.015146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:03.015932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:03.016374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:03.086671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-721a3a89-1e2c-4afc-8ba0-06aba1ea9d41 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084297 Nov 24 18:05:03.087220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 538/1073] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:04.097914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:04.098835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:04.106862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:04.107304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:04.108099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:04.108619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:04.173589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-30296bc8-3b7a-46b8-89e9-911efaa17280 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079383 Nov 24 18:05:04.174136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 536/1074] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:05.185279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:05.186189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:05.193319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:05.193763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:05.194553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:05.194981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:05.258611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-085dfae8-bb0e-4a34-b149-dca7e13c6340 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077074 Nov 24 18:05:05.259422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 539/1075] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:06.269232 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:06.270132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:06.277380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:06.277804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:06.278559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:06.278985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:06.344559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7f2f236c-a2c0-4bfa-91f8-d529b47bba73 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079021 Nov 24 18:05:06.345113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 537/1076] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:07.356387 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:07.357315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:07.364475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:07.364915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:07.365678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:07.366305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:07.431043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd3c541f-0560-4963-9ab1-5884ca5323d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078529 Nov 24 18:05:07.431840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 540/1077] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:08.442204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:08.443112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:08.450585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:08.451033 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:08.451839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:08.452276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:08.516802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-91d2a9be-385d-44b1-b630-7f1335a271bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078317 Nov 24 18:05:08.517552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 538/1078] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:09.528369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:09.529264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:09.536425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:09.536862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:09.537629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:09.538093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:09.601593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-df3dae76-098c-4fdc-a899-a7a18e043023 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076832 Nov 24 18:05:09.602045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 541/1079] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:10.612040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:10.612948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:10.620205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:10.620591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:10.621350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:10.621780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:10.692818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90f936b5-d5e4-4f75-92d8-a068fc465cb3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084523 Nov 24 18:05:10.693373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 539/1080] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:11.704636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:11.705470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:11.713110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:11.713543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:11.714293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:11.714713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:11.780552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-401cbc7a-86a8-46ab-be92-248fbd1128e8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079653 Nov 24 18:05:11.781104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 542/1081] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:12.792091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:12.792983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:12.800701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:12.801146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:12.801920 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:12.802352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:12.869407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6361b5f6-2678-4c60-9d28-ab0c4a62b493 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080864 Nov 24 18:05:12.869891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 540/1082] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:13.880636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:13.881647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:13.888981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:13.889426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:13.890188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:13.890619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:13.955746 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9c81f1a8-bc78-4a8e-8012-b72c4baaf81a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078784 Nov 24 18:05:13.956237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 543/1083] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:14.966183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:14.967076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:14.974197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:14.974637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:14.976667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:14.977100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:15.045903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-44d0fb01-e92d-401c-b267-3e9a0d8e3acd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083205 Nov 24 18:05:15.046454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 541/1084] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:16.057899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:16.058800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:16.065928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:16.066370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:16.067126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:16.067554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:16.129534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ffc8f4e7-4656-4c0f-90a9-8f7d14f4be96 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076226 Nov 24 18:05:16.130121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 544/1085] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:17.141465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:17.142362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:17.150508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:17.150945 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:17.151723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:17.152150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:17.216060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-928da260-ec94-47a6-bce1-9f1e17cb70f7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078341 Nov 24 18:05:17.216591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 542/1086] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:18.227775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:18.229037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:18.235824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:18.236270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:18.237026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:18.237453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:18.299473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2491ee70-05de-40c7-b39b-f22b6ed15d1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075705 Nov 24 18:05:18.300044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 545/1087] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:19.311376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:19.312326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:19.319764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:19.320209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:19.320988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:19.321399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:19.385637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c68f4635-8a50-4940-86b6-99d1374ff3de tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077914 Nov 24 18:05:19.386389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 543/1088] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:20.397456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:20.398400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:20.405568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:20.406007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:20.406755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:20.407176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:20.476527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-762cd299-3fa7-43c9-93a4-d97979f2f08b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082707 Nov 24 18:05:20.477077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 546/1089] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:21.488479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:21.489391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:21.497197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:21.497645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:21.498413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:21.498854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:21.561485 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-84b774d4-3025-49a7-9be2-1111336c132c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077055 Nov 24 18:05:21.562032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 544/1090] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:22.574084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:22.574986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:22.583742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:22.584235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:22.585073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:22.586147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:22.650915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5ea8c15e-1aae-4a5d-9385-e7747e45f216 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080510 Nov 24 18:05:22.651372 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 547/1091] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:23.662122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:23.663029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:23.670273 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:23.670969 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:23.671757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:23.672182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:23.738240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fd3ef2fc-3ba3-4e2b-ae9b-433e4ccf4ae4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079782 Nov 24 18:05:23.738698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 545/1092] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:24.749973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:24.750869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:24.758552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:24.758991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:24.759770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:24.760199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:24.831101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b0a6b2f4-4fb0-443c-9396-d75941f677d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084767 Nov 24 18:05:24.831669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 548/1093] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:25.842189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:25.843294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:25.851829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:25.852275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:25.853038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:25.853467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:25.915720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9945fe1c-3c9b-4a7b-be8a-393790767c1b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077341 Nov 24 18:05:25.916262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 546/1094] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:26.926528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:26.927364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:26.935371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:26.935845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:26.936604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:26.937054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:26.999551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-88b95d7a-037c-4a70-b68a-10d0772769a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076836 Nov 24 18:05:27.000123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 549/1095] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:28.010858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:28.011815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:28.018928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:28.019367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:28.020154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:28.020580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:28.083429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f7778547-9267-4b84-9a1c-71bb04aa0831 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076362 Nov 24 18:05:28.084042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 547/1096] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:29.094756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:29.095726 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:29.103987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:29.104434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:29.105194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:29.105622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:29.171616 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5e8bc0e7-03a3-4771-856a-ae968e00638e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080593 Nov 24 18:05:29.172185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 550/1097] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:30.182593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:30.183523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:30.190718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:30.191145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:30.191925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:30.192357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:30.254715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-452158a0-7638-4eb7-8890-b33cf581f38b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075766 Nov 24 18:05:30.255283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 548/1098] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:31.266024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:31.266924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:31.276246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:31.276975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:31.277744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:31.278177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:31.341236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-970ab7a4-398e-413d-87ff-55f687f94ea6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078842 Nov 24 18:05:31.341776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 551/1099] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:32.351454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:32.352381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:32.359459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:32.359926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:32.360678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:32.361102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:32.427748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0d554756-4acc-4d15-a5c2-60416315d082 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079940 Nov 24 18:05:32.428443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 549/1100] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:33.439173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:33.440111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:33.447798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:33.448238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:33.448989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:33.449412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:33.513459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5b5748ea-e824-4d96-bc1e-df3abaf53ebb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078044 Nov 24 18:05:33.514000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 552/1101] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:34.523844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:34.524777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:34.531947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:34.532399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:34.533163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:34.533598 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:34.596928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-09a28e5b-b0ee-44a3-9af3-30dceb8f5578 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076998 Nov 24 18:05:34.597475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 550/1102] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:35.609718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:35.610621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:35.617738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:35.618974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:35.619515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:35.619964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:35.681956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-70a60b01-5301-4c53-b973-20355d6e8913 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075858 Nov 24 18:05:35.682501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 553/1103] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:36.693082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:36.694018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:36.703847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:36.704511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:36.705607 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:36.706045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:36.768985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6348bcbf-2251-4a65-89ca-33bdae4a317f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079617 Nov 24 18:05:36.769538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 551/1104] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:37.780637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:37.781544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:37.788657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:37.789107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:37.790548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:37.790981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:37.858849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5858cf1d-8a87-4d86-8e65-9e551ce45aa4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081892 Nov 24 18:05:37.859415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 554/1105] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:38.870112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:38.871022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:38.878219 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:38.878662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:38.879419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:38.879880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:38.942075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f047a1ca-7f5f-49e5-b106-da02a0c67e56 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075651 Nov 24 18:05:38.942541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 552/1106] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:39.953180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:39.954078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:39.961087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:39.962032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:39.962795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:39.963219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:40.025475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8d05505f-8106-4e3a-ba61-63277f3fd32a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076002 Nov 24 18:05:40.026018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 555/1107] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:40.722512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:40.723055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:40.731498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:40.732005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:40.732762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:40.733189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:40.802011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:05:40.892239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:40.893646 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:40.901106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:40.901673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:40.902674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:40.903716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:40.928943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:05:40.965958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:05:41.086311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6ae4046b-8a84-4197-a3e9-11411cddbd52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "DELETE /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 204 len: 0 microversion: 2.1 time: 0.197274 Nov 24 18:05:41.088470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 556/1108] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:05:40 2021] DELETE /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:05:41.093809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:41.094824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:41.101822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.103322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:41.104117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.104540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:41.169981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4421dadf-7168-4482-bae6-75d4211e98c1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080693 Nov 24 18:05:41.170651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 557/1109] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:41.175409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:41.176031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:41.183811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.184255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:41.185008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.185440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:41.464847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:41.473462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-40d21380-260b-40f2-acdc-14402f9c73fe tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1560 microversion: 2.1 time: 0.301524 Nov 24 18:05:41.474022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 558/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:41 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1560 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:41.947560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 56128. Nov 24 18:05:41.972257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e1d32c0c-879c-46b8-bf7e-626e41556d6b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 204 len: 0 microversion: 2.1 time: 1.252961 Nov 24 18:05:41.973031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 553/1111] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:05:40 2021] DELETE /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 0 bytes in 1255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:05:41.981976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:41.982574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:41.990360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.990979 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:41.991921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:41.992543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:42.182751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:42.183923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:42.191570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:42.192060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:42.192827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:42.193402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:42.257128 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1f7a68b9-e2eb-4196-8578-c24bece317ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079269 Nov 24 18:05:42.257586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 554/1112] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:42.370183 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:42.380781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5a590060-1606-4284-ac17-c9524cd6cc16 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1513 microversion: 2.1 time: 0.402823 Nov 24 18:05:42.390728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 559/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:41 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:42.491955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:42.492565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:42.500661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:42.501106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:42.501871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:42.502302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:42.989026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-6be08dc4-e65c-4ba8-a971-970fec844bd0 req-a5dac484-77d1-4265-b931-501cad562d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16db57ca-063c-485b-a4a7-4d92fcfbde5a", "name": "network-vif-deleted", "tag": "10363e40-65d5-4242-9986-a18d5073f092"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:05:42.990896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:05:42.990896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:05:43.000128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6be08dc4-e65c-4ba8-a971-970fec844bd0 req-a5dac484-77d1-4265-b931-501cad562d90 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.000717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-6be08dc4-e65c-4ba8-a971-970fec844bd0 req-a5dac484-77d1-4265-b931-501cad562d90 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.016987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-6be08dc4-e65c-4ba8-a971-970fec844bd0 req-a5dac484-77d1-4265-b931-501cad562d90 service nova] Creating event network-vif-deleted:10363e40-65d5-4242-9986-a18d5073f092 for instance 16db57ca-063c-485b-a4a7-4d92fcfbde5a on hv-cinder-81857 Nov 24 18:05:43.022119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-6be08dc4-e65c-4ba8-a971-970fec844bd0 req-a5dac484-77d1-4265-b931-501cad562d90 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100246 Nov 24 18:05:43.022777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 560/1114] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:05:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:43.035442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:43.045380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2b141747-dd8e-4bbf-b972-2cb1dc343fdc tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1560 microversion: 2.1 time: 0.557510 Nov 24 18:05:43.056542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 555/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:42 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1560 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:43.269611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:43.270760 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:43.278681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.279055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.279844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.280417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.345618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1233c966-2c5e-4df1-8a38-8f359c9900b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080096 Nov 24 18:05:43.346204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 561/1116] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:43.397795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:43.398574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:43.406714 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.407276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.408085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.408635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.612798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:43.630733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-88d5b205-4c91-41d0-9852-d8f53aa33be1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 200 len: 1471 microversion: 2.1 time: 0.236492 Nov 24 18:05:43.632149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 556/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:43 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:43.705981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-3abfb670-96b3-4aa1-8983-6af98a5c88e6 req-b9c313cd-59ab-4be3-8edf-b6508ab36962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5719f540-c586-4e6a-aebe-53ae3101c2fb", "name": "network-vif-deleted", "tag": "d4a31d7c-2957-4b24-b24e-6d27d0f57bfb"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:05:43.708237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:05:43.708237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:05:43.718745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3abfb670-96b3-4aa1-8983-6af98a5c88e6 req-b9c313cd-59ab-4be3-8edf-b6508ab36962 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:43.719239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3abfb670-96b3-4aa1-8983-6af98a5c88e6 req-b9c313cd-59ab-4be3-8edf-b6508ab36962 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:43.736066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-3abfb670-96b3-4aa1-8983-6af98a5c88e6 req-b9c313cd-59ab-4be3-8edf-b6508ab36962 service nova] Creating event network-vif-deleted:d4a31d7c-2957-4b24-b24e-6d27d0f57bfb for instance 5719f540-c586-4e6a-aebe-53ae3101c2fb on hv-cinder-81857 Nov 24 18:05:43.740736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-3abfb670-96b3-4aa1-8983-6af98a5c88e6 req-b9c313cd-59ab-4be3-8edf-b6508ab36962 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121474 Nov 24 18:05:43.741339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 562/1118] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:05:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:44.064850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:44.065832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:44.074839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.075496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.076706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.077422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.198678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:44.207628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ae683bfd-eec2-4df5-90fb-28b260459c93 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.148609 Nov 24 18:05:44.208318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 557/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:44 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:44.358188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:44.359148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:44.366597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.367044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.368416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.368843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.435625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f3132ad6-6ae5-42f9-b054-55c45fbfb397 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081588 Nov 24 18:05:44.436171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 563/1120] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:44.648376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:44.649501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 5719f540-c586-4e6a-aebe-53ae3101c2fb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:44.656965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.657405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.658157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:44.658583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:44.708585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Instance 5719f540-c586-4e6a-aebe-53ae3101c2fb could not be found. Nov 24 18:05:44.709187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 404 to user: Instance 5719f540-c586-4e6a-aebe-53ae3101c2fb could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:05:44.710012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-62cce1b1-51f3-41a1-a908-83a8b120f9b1 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb" status: 404 len: 111 microversion: 2.1 time: 0.065279 Nov 24 18:05:44.710573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 558/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:44 2021] GET /compute/v2.1/servers/5719f540-c586-4e6a-aebe-53ae3101c2fb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:05:45.224558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:45.225159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:45.233229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:45.233695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:45.234440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:45.234873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:45.447864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:45.448381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:45.448830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:45.456703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9b023a49-ba46-4f6e-afa9-f50fdb6efe13 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.235839 Nov 24 18:05:45.457200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:45.457714 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:45.458586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:45.459094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:45.466582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 564/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:45 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:45.526380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bb1f512c-75bf-422b-80f9-dc9f4f77ae70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083638 Nov 24 18:05:45.526928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 559/1123] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:46.472871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:46.473482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:46.481380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:46.481821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:46.482577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:46.483007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:46.536890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:46.537796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:46.545614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:46.546318 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:46.547102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:46.547535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:46.594102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:46.603039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4df536f0-8467-4ee7-8fc5-e638ba8a7c2d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.133789 Nov 24 18:05:46.603803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 565/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:46 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:46.612800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d2a3c3bc-9b2b-4165-afd5-fb8675f7858b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079629 Nov 24 18:05:46.613337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 560/1125] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:47.619573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:47.620199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:47.624408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:47.625307 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:47.627567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:47.628039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:47.628811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:47.629245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:47.632323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:47.632760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:47.634146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:47.634577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:47.697441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b3098a95-a5af-4e99-97a2-d69e10d175ca tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076594 Nov 24 18:05:47.697904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 561/1126] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:47.745376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:47.753917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7da8f1e6-ada9-43d8-96e3-5697ef201966 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138522 Nov 24 18:05:47.754475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 566/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:47 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:48.708690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:48.709603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:48.717289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:48.717734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:48.718501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:48.718939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:48.771348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:48.771991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:48.779775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:48.780218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:48.780975 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:48.781405 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:48.789161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-76982741-9377-4ce9-ab47-ad28b1709e46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084311 Nov 24 18:05:48.789770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 562/1128] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:48.897854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:48.906919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ebc1cd72-670a-4e0f-8d56-01c0b306fd6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.139269 Nov 24 18:05:48.907472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 567/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:48 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:05:49.361102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:05:49.361300 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:05:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:05:49.800667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:49.801566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:49.809000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:49.809446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:49.810244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:49.810843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:49.874680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c7779a2-baed-46a8-a921-6caeb86f2c78 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077793 Nov 24 18:05:49.875145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 563/1130] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:49.924123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:49.924723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:49.931866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:49.932310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:49.933060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:49.933490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:50.046797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:50.055572 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ad92ec9f-edbc-44bf-8d21-43eba2ce4279 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135122 Nov 24 18:05:50.056233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 568/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:49 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:50.886145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:50.887059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:50.894482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:50.894934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:50.895738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:50.896172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:50.958423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-62c78745-29c6-430f-a7ea-072664091393 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076154 Nov 24 18:05:50.958960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 564/1132] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:51.072363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:51.072968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:51.080117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:51.080559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:51.081311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:51.081738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:51.192485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:51.201580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7e2fbd63-4401-46c1-9ea3-1c5daf198daf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132857 Nov 24 18:05:51.202142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 569/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:51 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:51.970450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:51.971282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:51.978700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:51.979145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:51.979943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:51.980383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:52.045149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fef1dcce-b2b5-46b9-b987-b3c7d0d22b33 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079135 Nov 24 18:05:52.045697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 565/1134] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:52.218005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:52.218630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:52.225920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:52.226355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:52.227958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:52.228387 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:52.262995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:05:52.263461 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:05:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a (ip 10.222.0.64) !!! Nov 24 18:05:52.517227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:52.526398 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3c619b18-bb87-4c0a-a7bc-551de7f0ef01 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.312036 Nov 24 18:05:52.526947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 570/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:52 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:52.935525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:52.936040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:52.943191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:52.943652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:52.944402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:52.944829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.006273 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:05:53.056993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:53.057887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:53.064922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.065360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.066121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.066549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.116944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0dd9f88c-87ae-4c2d-bd10-33ca3cddf6a1 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 204 len: 0 microversion: 2.1 time: 0.184696 Nov 24 18:05:53.118059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 566/1136] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:05:52 2021] DELETE /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:05:53.126378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:53.127134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:53.132852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3646ae46-eec2-4fcd-8753-e3c888330e70 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080261 Nov 24 18:05:53.133590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 571/1137] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:53.134308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.134760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.135525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.136077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.334875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:53.344494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-03395134-b94e-4376-b767-43f85c6d5b61 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1554 microversion: 2.1 time: 0.222063 Nov 24 18:05:53.345074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 567/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:53 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:05:53.542845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:53.543449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:53.550839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.551282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.552072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:53.552498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:53.660784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:53.670535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37de395d-864f-4250-8b1c-81987118ebac tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132106 Nov 24 18:05:53.671351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 572/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:53 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:54.144294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:54.145196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:54.153293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.153740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.154498 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.154930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.218424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2bc69746-9ec7-4224-9c79-ed6e9932260b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077800 Nov 24 18:05:54.218984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 568/1140] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:54.362621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:54.363224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:54.371316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.371790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.372554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.373555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.502497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-e44df72d-e757-4b23-8ca9-924a67deb91f req-00e7a3ff-4b3d-446f-bfbb-d6ae9cdc8694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f3309e-4d8f-4562-8be3-1ee956122852", "name": "network-vif-deleted", "tag": "1fa4f15a-1ecf-4e05-834f-c09fef5e4202"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:05:54.505191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:05:54.505191 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:05:54.506812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5574b71257949beac538ca9b8cd753d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f9fe515b48740349e895a3c54d63a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:54.515344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e44df72d-e757-4b23-8ca9-924a67deb91f req-00e7a3ff-4b3d-446f-bfbb-d6ae9cdc8694 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.515955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e44df72d-e757-4b23-8ca9-924a67deb91f req-00e7a3ff-4b3d-446f-bfbb-d6ae9cdc8694 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.517065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-03f950c9-9aee-42d6-870a-f6e827d0c630 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 200 len: 1512 microversion: 2.1 time: 0.158121 Nov 24 18:05:54.517985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 573/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:54 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:54.536804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-e44df72d-e757-4b23-8ca9-924a67deb91f req-00e7a3ff-4b3d-446f-bfbb-d6ae9cdc8694 service nova] Creating event network-vif-deleted:1fa4f15a-1ecf-4e05-834f-c09fef5e4202 for instance c4f3309e-4d8f-4562-8be3-1ee956122852 on hv-cinder-81857 Nov 24 18:05:54.542654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-e44df72d-e757-4b23-8ca9-924a67deb91f req-00e7a3ff-4b3d-446f-bfbb-d6ae9cdc8694 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043899 Nov 24 18:05:54.543245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 569/1142] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:05:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:05:54.692497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:54.693102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:54.700462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.700910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.701674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:54.702104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:54.822596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:54.831436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f8f2925b-2fca-4288-b4f2-31d80e05b267 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.142667 Nov 24 18:05:54.832011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 574/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:54 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:55.230510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:55.231487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:55.238892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.239333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.240132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.240560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.304986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9e33a4d9-4755-484e-a8b4-17eddd0a80b9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079323 Nov 24 18:05:55.305547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 570/1144] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:55.533961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:55.534556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] [instance: c4f3309e-4d8f-4562-8be3-1ee956122852] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:55.542030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.542467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.543219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.543665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.597043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] HTTP exception thrown: Instance c4f3309e-4d8f-4562-8be3-1ee956122852 could not be found. Nov 24 18:05:55.597700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Returning 404 to user: Instance c4f3309e-4d8f-4562-8be3-1ee956122852 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:05:55.598512 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-97617840-bccb-442c-b2a9-153222d469cb tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852" status: 404 len: 111 microversion: 2.1 time: 0.068233 Nov 24 18:05:55.599049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 575/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:55 2021] GET /compute/v2.1/servers/c4f3309e-4d8f-4562-8be3-1ee956122852 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:05:55.607456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-157a9692-bdef-4d68-893e-8dc6adfca8c3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] Calling method '.version_select at 0x7f8b10042040>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:55.628283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-157a9692-bdef-4d68-893e-8dc6adfca8c3 tempest-TestMinimumBasicScenario-120971299 tempest-TestMinimumBasicScenario-120971299-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813511141" status: 202 len: 0 microversion: 2.1 time: 0.024364 Nov 24 18:05:55.628841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 571/1146] 10.222.0.64 () {58 vars in 1271 bytes} [Wed Nov 24 18:05:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1813511141 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:05:55.847879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:55.848691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:55.856952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.857399 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.858200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:55.859038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:55.977368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:55.988950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-33f506a0-baaf-4c0f-8b62-746c43f79690 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.144671 Nov 24 18:05:55.989833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 576/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:55 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:56.316479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:56.317399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:56.324818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:56.325202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:56.325981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:56.326419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:56.392651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-efb00938-e5b6-46d7-9b90-e880ff064a4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079905 Nov 24 18:05:56.393995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 572/1148] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:57.013832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:57.014613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:57.021753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:57.022197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:57.022961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:57.023397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:57.168805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:57.178042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ee50bfd4-17ca-4cc4-8047-e60ca1faaf36 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.167944 Nov 24 18:05:57.178679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 577/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:57 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:57.405408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:57.406408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:57.413802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:57.414368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:57.415904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:57.416405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:57.482097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cbab08e4-8230-484b-af0a-7ab4907ebe8e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080510 Nov 24 18:05:57.482652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 573/1150] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:58.194790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:58.195455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:58.203525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:58.204095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:58.204924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:58.205555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:58.378647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:58.389309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6643e420-210e-4d6d-82b3-134aba1f0553 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.198087 Nov 24 18:05:58.399263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 578/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:58 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:58.494583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:58.495516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:58.503048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:58.503506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:58.504338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:58.504775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:58.573863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-913dcba3-c048-4bd5-970c-cffb4467fd4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083607 Nov 24 18:05:58.574429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 574/1152] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:05:59.406375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:59.407854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:59.416208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:59.416906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:59.418121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:59.418805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:59.586184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:05:59.587243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:05:59.594534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:59.595206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:59.596267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:05:59.596700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:05:59.601183 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:05:59.613530 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7000b49d-4162-44b4-a309-3b22dfb63d51 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.210762 Nov 24 18:05:59.624987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 579/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:05:59 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:05:59.663918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4ac9963e-18c3-43cf-ae21-282a315b8948 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082461 Nov 24 18:05:59.667689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 575/1154] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:05:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:00.631258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:00.631881 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:00.639670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:00.640111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:00.640866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:00.641293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:00.675773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:00.677305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:00.686032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:00.686475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:00.687239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:00.687691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:00.752486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f357a850-13cb-4adf-a857-eeca43fcb4a5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080405 Nov 24 18:06:00.753049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 576/1155] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:00.783650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:00.801597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ac9bbe75-a780-45a5-971d-7b70be4abc0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.173985 Nov 24 18:06:00.802178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 580/1156] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:00 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:01.765218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:01.766343 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:01.774032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:01.774679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:01.775531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:01.776172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:01.818652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:01.819932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:01.828270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:01.828957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:01.829894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:01.830485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:01.842626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1e110283-f25c-4824-abe0-167a78c62cde tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081233 Nov 24 18:06:01.843299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 577/1157] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:02.000651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:02.010468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0215d05f-b0ae-4a4c-aed8-48da1c520075 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.195396 Nov 24 18:06:02.011019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 581/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:01 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:06:03.028194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:03.029084 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:03.036751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:03.037197 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:03.037967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:03.038395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:03.081537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:03.082497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:03.090615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:03.091067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:03.091871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:03.092302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:03.160710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e7892e4d-05ae-4c0c-9c47-308965ddf431 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.310184 Nov 24 18:06:03.164579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 578/1159] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:03.195842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:03.204725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2c6c96e4-38d9-4339-8b47-fb743a9962aa tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.180155 Nov 24 18:06:03.205724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 582/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:03 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:06:04.172526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:04.173542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:04.181080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:04.181580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:04.182303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:04.182735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:04.221180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:04.221942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:04.230968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:04.231897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:04.232850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:04.233455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:04.248228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a906f46c-6586-4c41-b5fe-ec18d3d16069 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079738 Nov 24 18:06:04.249222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 579/1161] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:04.357857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:04.366255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-44841161-320e-4e5d-a20d-b8381312f81e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.148707 Nov 24 18:06:04.366795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 583/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:04 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:06:05.260358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:05.261454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:05.270051 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:05.270739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:05.271688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:05.272277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:05.346772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1a0c5b14-99dd-4355-8229-0b6f98d19698 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090858 Nov 24 18:06:05.351331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 580/1163] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:05.384249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:05.384903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:05.408623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:05.409275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:05.410217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:05.410815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:05.549706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:05.558964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-093ff7c4-e6f0-49d8-b28e-f8ff07b84bcb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.179231 Nov 24 18:06:05.559526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 584/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:05 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:06.359294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:06.360382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:06.372091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:06.372403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:06.373259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:06.373844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:06.450143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a87f9089-a809-449d-b7af-69a98e83500a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094980 Nov 24 18:06:06.451666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 581/1165] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:06.576510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:06.577720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:06.585290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:06.587391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:06.588436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:06.589089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:06.717665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:06.727424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-30aec858-36eb-42bd-aaca-771a20aad7af tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.154005 Nov 24 18:06:06.736467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 585/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:06 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:07.464522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:07.465726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:07.473186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:07.473638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:07.474412 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:07.474848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:07.547209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-70d53b63-b002-477b-85ee-ba5ce61e5a6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088598 Nov 24 18:06:07.551119 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 582/1167] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:07.743910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:07.744571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:07.751803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:07.752245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:07.753016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:07.753454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:07.888950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:07.899464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-efb89052-5cc1-4615-b584-669816f0eecb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.157717 Nov 24 18:06:07.899464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 586/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:07 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:08.558967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:08.559899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:08.566953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:08.567402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:08.568203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:08.568817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:08.632142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4513ebb5-e2f7-4085-b7fa-8af9de599f92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077445 Nov 24 18:06:08.633463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 583/1169] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:08.916304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:08.916830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:08.924251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:08.924697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:08.925449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:08.925875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:09.035036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:09.044428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-29d5539a-634b-4448-b723-cb935cbd49c5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132757 Nov 24 18:06:09.044978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 587/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:08 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:09.644257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:09.645168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:09.653225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:09.653674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:09.654431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:09.654862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:09.717583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d16b0e18-20b4-4169-91cd-6bdd69533181 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077045 Nov 24 18:06:09.718056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 584/1171] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:10.060563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:10.061168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:10.068232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:10.068671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:10.069424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:10.069856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:10.186531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:10.195272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0060d4cf-7b55-4879-a2d9-10afeb1802c6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138351 Nov 24 18:06:10.196152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 588/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:10 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:10.729135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:10.729959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:10.737219 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:10.737664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:10.738423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:10.738854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:10.802636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-855be6d7-11b9-4ff9-9b61-f7c53a8c1b09 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077481 Nov 24 18:06:10.803185 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 585/1173] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:11.211327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:11.211955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:11.219091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:11.219526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:11.220299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:11.220724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:11.334433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:11.343012 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f4a1ae0f-ae3e-465b-8025-ebf82a75acb3 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135484 Nov 24 18:06:11.343567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 589/1174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:11 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:11.814175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:11.815083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:11.823005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:11.823452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:11.824253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:11.824686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:11.890501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5b0bb6df-ec17-4403-aa5f-b69d51377c9f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080060 Nov 24 18:06:11.891052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 586/1175] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:12.359737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:12.360376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:12.368140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:12.368583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:12.369351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:12.369779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:12.480681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:12.489526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dde2065b-1fd3-44e0-8835-c7d8105a2213 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.133375 Nov 24 18:06:12.490121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 590/1176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:12 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:12.902096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:12.903137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:12.910337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:12.910782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:12.911538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:12.911995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:12.975647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5192b2cc-7053-497a-a0be-cb1fe76b21ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077547 Nov 24 18:06:12.977104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 587/1177] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:13.505914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:13.506537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:13.518222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:13.518222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:13.518222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:13.518222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:13.630593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:13.639832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37c4107d-57ce-4a3a-9395-684c6ed821e9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137493 Nov 24 18:06:13.640383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 591/1178] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:13 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:13.988012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:13.988972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:13.996887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:13.997333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:13.998093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:13.998524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:14.062590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f34cde92-530c-4cc0-a9ec-ab70d0ec6f49 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078293 Nov 24 18:06:14.063135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 588/1179] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:14.657408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:14.657959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:14.666266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:14.666712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:14.667472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:14.667937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:14.779235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:14.787561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d056beb7-2a4c-49a9-a39a-a7554ca5f44e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134016 Nov 24 18:06:14.788124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 592/1180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:14 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:15.073951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:15.074882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:15.081987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:15.082431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:15.083180 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:15.083623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:15.145126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0bd5b0f3-96c9-4edb-b827-13e47560c2cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075499 Nov 24 18:06:15.145669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 589/1181] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:15.805559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:15.806193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:15.813351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:15.813792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:15.814542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:15.814970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:15.939563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:15.949688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-204d9e79-c279-4500-b1d1-9550f8e2c76f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.147851 Nov 24 18:06:15.950173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 593/1182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:15 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:16.156913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:16.157806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:16.171216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:16.171216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:16.171216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:16.171216 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:16.235278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f4a37bda-ec79-4080-a8c3-a5b430869bf5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081868 Nov 24 18:06:16.235769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 590/1183] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:16.967093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:16.967723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:16.974922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:16.975305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:16.976712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:16.977314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:17.090901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:17.099295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd95ee99-e964-45be-8c79-d6403a781fbd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135885 Nov 24 18:06:17.099869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 594/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:16 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:17.246620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:17.247490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:17.254636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:17.255075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:17.255856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:17.256290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:17.321352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a2680e45-63fa-4523-89d4-1dd6eea78e01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078509 Nov 24 18:06:17.321895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 591/1185] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:18.116075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:18.117278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:18.124277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:18.124720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:18.125476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:18.125904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:18.242623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:18.251096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0809b4d8-59fb-4f27-9be7-656e5d7c1e57 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138746 Nov 24 18:06:18.251657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 595/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:18 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:18.332571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:18.333482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:18.341300 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:18.341748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:18.342519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:18.342953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:18.406859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d64d4303-0a61-4694-a6f1-be4bf87706f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078008 Nov 24 18:06:18.407418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 592/1187] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:19.268131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:19.268740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:19.275960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:19.276401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:19.277153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:19.277581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:19.387203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:19.395720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e8679ab7-7a06-485b-8491-86befa39c139 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.131200 Nov 24 18:06:19.396268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 596/1188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:19 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:19.417132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:19.418040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:19.425513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:19.425964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:19.426730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:19.427168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:19.490298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-331c4740-2967-4f27-87e2-3b078c0b2d83 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076943 Nov 24 18:06:19.490962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 593/1189] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:20.412845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:20.414007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:20.421835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:20.422277 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:20.423037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:20.423471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:20.501873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:20.502788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:20.510089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:20.510534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:20.511304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:20.511768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:20.540899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:20.549805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-013be8e9-67a2-4f8c-9333-0e8270d349c9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.140676 Nov 24 18:06:20.550357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 597/1190] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:20 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:20.581579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-74df5763-b4f8-4f8f-9671-20146bf14bf0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083378 Nov 24 18:06:20.582124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 594/1191] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:21.569523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:21.570909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:21.578827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:21.579273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:21.580057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:21.580487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:21.593776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:21.594676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:21.603013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:21.603457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:21.604316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:21.604743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:21.669983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ea02c92f-a306-4c84-b986-03863d909dad tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079875 Nov 24 18:06:21.670547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 595/1192] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:21.703853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:21.712404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c9a53091-1428-409b-b165-dbec42ef1665 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.148787 Nov 24 18:06:21.712954 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 598/1193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:21 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:22.682136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:22.683041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:22.690367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:22.690814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:22.691575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:22.692030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:22.729474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:22.730105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:22.737419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:22.737863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:22.738623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:22.739053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:22.755460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e67b26b5-70ea-4512-81c8-044fc6ba0350 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077599 Nov 24 18:06:22.756048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 596/1194] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:22.852306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:22.860854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b5021110-c8b8-410f-a631-857ba5a0750f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135157 Nov 24 18:06:22.861411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 599/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:22 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:23.767740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:23.768662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:23.776418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:23.776863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:23.777621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:23.778052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:23.840959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5b40adf8-7f64-456f-b933-1f9acdf62dc1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077057 Nov 24 18:06:23.841515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 597/1196] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:23.878058 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:23.878666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:23.886847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:23.887293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:23.888090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:23.888523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:24.006716 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:24.016323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-357e12cb-e0ae-477f-954d-2ce60c4d0e96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.142046 Nov 24 18:06:24.016868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 600/1197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:23 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:24.852749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:24.853656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:24.861257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:24.861703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:24.862469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:24.862895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:24.932782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cf2312d3-1db2-4640-95be-649b320a557f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084252 Nov 24 18:06:24.933333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 598/1198] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:25.033154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:25.033819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:25.041561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:25.042060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:25.042821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:25.043250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:25.164708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:25.174191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5196f304-1d10-411f-991d-5c91425b7c4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.144651 Nov 24 18:06:25.174736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 601/1199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:25 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:25.944083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:25.945762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:25.953044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:25.953509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:25.954251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:25.954684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:26.017634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e4dd7f81-7413-4dc5-b229-4e8762b61bc8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077315 Nov 24 18:06:26.018183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 599/1200] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:26.189915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:26.190527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:26.198035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:26.198416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:26.199170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:26.199612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:26.308998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:26.317507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7f4d4ac9-1e08-4e12-97df-178312bf1fe2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.131317 Nov 24 18:06:26.318051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 602/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:26 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:27.029799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:27.030711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:27.038811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:27.039419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:27.040222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:27.040659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:27.104949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-13a1350e-788b-4f2c-b4a3-57e38320e5f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078888 Nov 24 18:06:27.105499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 600/1202] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:27.333955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:27.334550 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:27.341829 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:27.342266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:27.343037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:27.343459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:27.457605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:27.467211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-48a74143-066f-4c61-bfaa-4b52e142c342 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136964 Nov 24 18:06:27.467781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 603/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:27 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:28.116795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:28.117698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:28.124978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:28.125514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:28.126605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:28.127110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:28.191890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4273da77-9c61-466b-9db8-0756375785fb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079273 Nov 24 18:06:28.192439 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 601/1204] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:28.484537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:28.485139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:28.493116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:28.493554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:28.494309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:28.494737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:28.607103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:28.615467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-678d80df-4bf7-4a11-b32e-198cea97298b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134621 Nov 24 18:06:28.616035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 604/1205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:28 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:29.203880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:29.204704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:29.213207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:29.213674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:29.214432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:29.214858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:29.282210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9e287ffb-9ddf-431e-bc4d-b3ed2717190d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082162 Nov 24 18:06:29.282754 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 602/1206] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:29.633997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:29.634593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:29.641649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:29.642086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:29.642834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:29.643258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:29.753859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:29.763479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4151ee1a-89c9-4980-9011-7a8e54c720e7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134327 Nov 24 18:06:29.764048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 605/1207] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:29 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:30.294497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:30.295428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:30.302976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:30.303421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:30.304874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:30.305302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:30.368164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-506dc324-4b70-467d-8d20-af1569fca626 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077412 Nov 24 18:06:30.368699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 603/1208] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:30.780045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:30.780675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:30.787906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:30.788352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:30.789103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:30.789529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:30.902753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:30.911320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6af0214e-a9f9-48cb-8010-8e835755b09b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134938 Nov 24 18:06:30.911903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 606/1209] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:30 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:31.379816 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:31.380684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:31.387970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:31.388418 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:31.389188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:31.389623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:31.453380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8079c92b-1099-4e9f-b05e-ebf4c2bf5226 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077432 Nov 24 18:06:31.453946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 604/1210] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:31.927776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:31.928360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:31.935562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:31.936030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:31.936787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:31.937213 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:32.064334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:32.073933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e993d4bd-d044-4b84-a297-7920ee211318 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.149806 Nov 24 18:06:32.074491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 607/1211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:31 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:32.464844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:32.465753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:32.472992 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:32.473438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:32.474196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:32.474629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:32.537224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f1f6e92a-13ae-4634-94cf-2fed3ec640ab tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076153 Nov 24 18:06:32.537783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 605/1212] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:33.090474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:33.091445 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:33.098369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:33.098807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:33.099566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:33.100019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:33.211168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:33.219698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1ac006e3-5c91-46d4-ab2c-1ec424d8e12f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132831 Nov 24 18:06:33.220250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 608/1213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:33 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:33.548800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:33.549707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:33.557967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:33.558409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:33.559163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:33.559634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:33.628281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cdc1db04-c092-422a-9e28-b629b31ec4b5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083321 Nov 24 18:06:33.628743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 606/1214] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:34.236465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:34.237069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:34.244447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:34.244890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:34.245647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:34.246075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:34.363418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:34.373065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fd56fc9a-8c36-4b26-95fd-1551f2eae378 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.140216 Nov 24 18:06:34.383164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 609/1215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:34 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:34.409985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:06:34.410384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:06:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:06:34.640078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:34.640985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:34.648811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:34.649279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:34.650024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:34.650488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:34.713556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3d776797-88c0-4e81-811b-48a17624e3a4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077202 Nov 24 18:06:34.714099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 607/1216] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:35.389784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:35.390369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:35.398741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:35.399182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:35.399971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:35.400529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:35.518740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:35.527987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bf53e487-d682-4e97-a1ce-505d4434af8e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.141792 Nov 24 18:06:35.528624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 610/1217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:35 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:35.724872 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:35.726360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:35.733444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:35.733888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:35.734651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:35.735082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:35.797792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-eb756ca0-562e-45b0-991b-d81b371066cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076806 Nov 24 18:06:35.798343 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 608/1218] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:36.545032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:36.545626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:36.552997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:36.553441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:36.554313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:36.554748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:36.672366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:36.681460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c82898d4-b4a0-44a3-adbf-554cc402ef7b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.139981 Nov 24 18:06:36.682036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 611/1219] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:36 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:36.809277 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:36.810204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:36.817388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:36.817827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:36.818586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:36.819544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:36.883887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b7cff312-9dd8-4326-8f77-c37b4b7d7933 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078317 Nov 24 18:06:36.884432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 609/1220] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:37.698022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:37.698591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:37.705853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:37.706297 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:37.707060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:37.707522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:37.823133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:37.831743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4ffb3651-9576-4c11-85ab-cbed1e0cab23 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137416 Nov 24 18:06:37.832290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 612/1221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:37 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:37.894145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:37.895040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:37.903147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:37.903588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:37.904370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:37.904793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:37.970524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-01303658-9959-491a-92e9-955e16727f60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080050 Nov 24 18:06:37.970986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 610/1222] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:38.848690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:38.849294 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:38.856900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:38.857336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:38.858083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:38.858513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:38.982279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:38.983244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:38.990547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:38.992044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:38.992935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:38.993477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:38.994012 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:39.002630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1039865c-ce72-4cac-942b-9c02da1a7b60 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.157537 Nov 24 18:06:39.003176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 613/1223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:38 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:39.057561 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5e90a45e-e1c1-477f-825f-ff5f464d46e4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079038 Nov 24 18:06:39.058117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 611/1224] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:40.020118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:40.020751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:40.027958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:40.028397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:40.029156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:40.029586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:40.067889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:40.068834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:40.076541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:40.076993 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:40.077762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:40.078201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:40.142523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:40.142859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a34ccacf-fa8b-4ecd-926b-d81ea2025233 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078669 Nov 24 18:06:40.143440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 612/1225] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:40.151249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5dbce025-235a-47c9-a3a0-7cea883c5c81 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135249 Nov 24 18:06:40.151821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 614/1226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:40 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:41.154174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:41.155084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:41.162281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:41.162770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:41.163577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:41.164044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:41.167944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:41.168576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:41.175866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:41.176302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:41.177051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:41.177476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:41.229490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ce466aa5-6580-4545-930f-47f1c8e972fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079035 Nov 24 18:06:41.230312 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 613/1227] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:41.293307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:41.302003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-01dcabe0-e324-4c3a-a90c-2991a0febe90 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137643 Nov 24 18:06:41.302755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 615/1228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:41 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:06:42.239704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:42.240607 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:42.248694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:42.249137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:42.249886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:42.250309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:42.319945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:42.320750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:42.321807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-06e74cb6-c9e6-440f-a173-7614322fdaa5 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085753 Nov 24 18:06:42.322555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 614/1229] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:42.328531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:42.328973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:42.329774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:42.330202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:42.446194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:42.454892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8eed3a00-c066-4bcb-b287-85e8749488c0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.139189 Nov 24 18:06:42.455373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 616/1230] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:42 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:06:43.333058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:43.333971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:43.342026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:43.342477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:43.343250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:43.343712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:43.406608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8c099187-91c5-4801-aabb-2c023384a424 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077222 Nov 24 18:06:43.407173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 615/1231] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:43.471462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:43.472121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:43.479490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:43.479964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:43.480717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:43.481159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:43.591009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:43.599430 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2ed9b369-4e00-4f05-99bb-a1f0d28ee7b5 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.131640 Nov 24 18:06:43.600005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 617/1232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:43 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:44.418563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:44.419481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:44.426883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:44.427331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:44.428132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:44.429188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:44.491690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d100dc79-cfe6-49a3-b19c-7500a7d0fe0a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076738 Nov 24 18:06:44.492248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 616/1233] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:44.615739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:44.616583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:44.623992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:44.624292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:44.625055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:44.625483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:44.741661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:44.750068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37d1dbc4-1528-4d95-aab9-7cfb7cf5ef32 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138055 Nov 24 18:06:44.750821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 618/1234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:44 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:45.502980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:45.503900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:45.511543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:45.512044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:45.512795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:45.513220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:45.575529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7f733611-8d6f-4b23-88e3-9b9855a8f11f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076394 Nov 24 18:06:45.576137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 617/1235] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:45.766948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:45.767558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:45.775545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:45.776007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:45.776756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:45.777227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:45.891889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:45.900889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-688803ba-5f99-4421-9d0d-026e14d843e4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137669 Nov 24 18:06:45.901438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 619/1236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:45 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:46.586635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:46.587536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:46.594711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:46.595155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:46.595950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:46.596383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:46.661546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9518c3c1-35b5-4c85-9abb-0e0bf180a9c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079227 Nov 24 18:06:46.662098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 618/1237] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:46.918612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:46.919750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:46.927352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:46.927838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:46.929092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:46.929523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:47.042387 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:47.056857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-854e37c9-7831-4cea-a288-d666acb174e0 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.143083 Nov 24 18:06:47.057698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 620/1238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:46 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:47.673184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:47.674345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:47.682112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:47.682552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:47.683305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:47.683876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:47.747804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cbb9e3bb-38f4-495c-90f7-5678fc6f3de0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078395 Nov 24 18:06:47.748262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 619/1239] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:48.073982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:48.074596 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:48.081787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:48.082236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:48.082994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:48.083427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:48.270513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:48.279680 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-336179b6-0ccd-488f-9eaa-d31face75859 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.209354 Nov 24 18:06:48.280232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 621/1240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:48 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:48.757302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:06:48.763764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:48.763764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:48.768796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:48.769249 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:48.770023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:48.770459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:48.833622 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7109a216-922a-48bd-81cc-98526732143b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078196 Nov 24 18:06:48.834177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 620/1241] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:49.297228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:49.297841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:49.306471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:49.306923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:49.307717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:49.308150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:49.421368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:49.430637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a752a91a-2794-4643-a7c2-690d83ca92f1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137440 Nov 24 18:06:49.431180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 622/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:49 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:49.844905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:49.845818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:49.864137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:49.864586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:49.865365 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:49.865801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:49.913851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 56918. Nov 24 18:06:49.934513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e983b99e-4650-4d8e-bc46-0afc68fd7257 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093283 Nov 24 18:06:49.935065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 621/1243] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:50.447421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:50.448060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:50.455207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:50.455712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:50.456470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:50.456904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:50.567116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:50.576155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4b7e6044-5efc-4711-8813-aaa14f4ccfa1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.133252 Nov 24 18:06:50.576695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 623/1244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:50 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:50.945855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:50.946790 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:50.954016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:50.954466 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:50.955233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:50.955705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:51.025500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-74b6344e-1c63-4266-b023-02ab0a8b5e4e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083361 Nov 24 18:06:51.026052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 622/1245] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:51.592965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:51.593565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:51.601316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:51.601775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:51.602527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:51.602955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:51.715245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:51.723684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0c6b98e8-a970-4d58-80d7-6b31ffef16d4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134369 Nov 24 18:06:51.724233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 624/1246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:51 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:52.036663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:52.037649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:52.045168 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:52.045615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:52.046634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:52.047067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:52.116007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fb63ced1-cdbb-48bb-94a0-580832ff3e85 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083013 Nov 24 18:06:52.117078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 623/1247] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:52.740509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:52.741059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:52.748107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:52.748539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:52.749283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:52.749708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:52.864695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:52.873180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-986f2873-9512-4903-b073-b1eb7c28cdda tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136446 Nov 24 18:06:52.873724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 625/1248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:52 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:53.127980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:53.128881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:53.136577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:53.137014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:53.137772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:53.138198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:53.201500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-12829b76-2b2d-47b1-936a-c77559edc5a6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077242 Nov 24 18:06:53.202056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 624/1249] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:53.889885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:53.890466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:53.897715 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:53.898298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:53.899055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:53.899484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:54.009241 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:54.017651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f0a7d30c-7d63-4e59-8ab9-8217f8919a4a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.131494 Nov 24 18:06:54.018196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 626/1250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:53 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:54.213105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:54.214008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:54.221197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:54.221641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:54.222433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:54.222870 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:54.295685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f57a2162-551a-4936-aecf-40edf004baf6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086701 Nov 24 18:06:54.296501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 625/1251] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:55.034069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:55.034656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:55.041974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:55.042421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:55.043182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:55.043637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:55.157298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:55.166336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-08416822-1c50-4440-b06c-50ce87fa8b19 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135957 Nov 24 18:06:55.167107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 627/1252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:55 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:55.315973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:55.316871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:55.324810 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:55.325393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:55.326183 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:55.326611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:55.390659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-93d41a58-319d-4008-8614-96c5df6817a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078311 Nov 24 18:06:55.391210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 626/1253] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:56.183123 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:56.183749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:56.191035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:56.191469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:56.192276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:56.192700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:56.309794 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:56.318412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7347c9d3-d2af-48fa-8181-ab14edda58ab tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138953 Nov 24 18:06:56.318896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 628/1254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:56 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:56.402524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:56.403502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:56.410734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:56.411268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:56.412065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:56.412490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:56.475904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4f73400a-fcad-49ae-9f38-a0229d5ab02b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077131 Nov 24 18:06:56.476452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 627/1255] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:57.335750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:57.336587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:57.343802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:57.344252 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:57.345037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:57.345471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:57.457538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:57.466599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2f29cb50-121f-47b2-84ae-ec2d5f6be31d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135008 Nov 24 18:06:57.467190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 629/1256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:57 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:57.487067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:57.487994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:57.495484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:57.496012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:57.496771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:57.497199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:57.559690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-38f12364-d1f0-401e-9e48-9cfb4fbfc809 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076198 Nov 24 18:06:57.560158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 628/1257] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:58.483652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:58.484261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:58.492495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:58.492834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:58.493639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:58.494037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:58.570463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:58.571370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:58.578609 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:58.579059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:58.579841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:58.580268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:58.608943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:58.618208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2fedf131-34ff-4581-a7f6-bda6d763214b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138176 Nov 24 18:06:58.618777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 630/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:58 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:06:58.646370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f794cdcd-53a4-4ced-8850-2ec1fd84e9c2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079826 Nov 24 18:06:58.646837 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 629/1259] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:06:59.635828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:59.636428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:59.643401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:59.643863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:59.644622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:59.645045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:59.661962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:06:59.661962 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:06:59.667019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:59.667457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:59.668253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:06:59.668696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:06:59.732167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4e6b0847-ad41-4666-9e86-d6339f9c5b1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077586 Nov 24 18:06:59.732633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 630/1260] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:06:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:06:59.761173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:06:59.769662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-02223738-ea73-48b7-a149-896442e2ed6a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138700 Nov 24 18:06:59.770207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 631/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:06:59 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:00.743589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:00.744414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:00.751719 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:00.752169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:00.752941 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:00.753374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:00.786041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:00.786731 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:00.793770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:00.794204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:00.794949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:00.795373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:00.817089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1f473c70-8bb0-4635-9e55-16803cf3c8cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077398 Nov 24 18:07:00.817831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 631/1262] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:00.914052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:00.922924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-29283fa2-e951-4aef-95d9-733affdce2fd tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.140507 Nov 24 18:07:00.923476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 632/1263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:00 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:07:01.828873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:01.829888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:01.837477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:01.838082 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:01.838827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:01.839095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:01.902306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1b015e4a-5a3f-4053-bee0-4e65f6eb2536 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077166 Nov 24 18:07:01.902853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 632/1264] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:01.940958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:01.941607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:01.949040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:01.949473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:01.950217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:01.950640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:02.064267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:02.083703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c47c6da4-17e8-43b1-ab72-e17de264b382 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.146229 Nov 24 18:07:02.084289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 633/1265] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:01 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:02.914141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:02.915047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:02.922333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:02.922779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:02.923548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:02.924006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:02.990024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0510c403-be64-4236-9149-c5b5b1dc8316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080230 Nov 24 18:07:02.990566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 633/1266] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:03.102933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:03.103517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:03.111038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:03.111476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:03.112275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:03.112705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:03.227999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:03.236558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-18bf22e7-2577-4d14-87e2-0be72fa080b4 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137980 Nov 24 18:07:03.237110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 634/1267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:03 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:04.001750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:04.002659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:04.009811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:04.010253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:04.011297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:04.011760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:04.075917 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8ce1caab-af9b-41b4-bb23-ee545082702e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077856 Nov 24 18:07:04.076469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 634/1268] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:04.253386 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:04.253988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:04.261200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:04.261645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:04.262402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:04.262840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:04.374288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:04.383774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fb25c8dd-74b0-4de6-9beb-7c82a7ca2b5a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134013 Nov 24 18:07:04.384334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 635/1269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:04 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:05.087359 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:05.088295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:05.095469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:05.096148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:05.096917 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:05.097544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:05.163381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-df92ad1e-a971-44b8-9f74-dd15d6cb6c29 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079143 Nov 24 18:07:05.163982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 635/1270] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:05.400539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:05.401158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:05.408555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:05.408996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:05.409751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:05.410180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:05.523513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:05.531933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-251abbbc-34c3-4c70-ac34-911aa31289c1 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135746 Nov 24 18:07:05.532494 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 636/1271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:05 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:06.174419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:06.175328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:06.183317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:06.183794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:06.184557 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:06.184987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:06.248135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1fa13088-c8e0-48c3-98c9-ccdea59efbe0 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077702 Nov 24 18:07:06.248685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 636/1272] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:06.549201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:06.549934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:06.557823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:06.558267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:06.559023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:06.559456 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:06.673471 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:06.682753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cb54606d-6041-4a44-8a6d-4d47ee4e4336 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137513 Nov 24 18:07:06.683311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 637/1273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:06 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:07.259782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:07.260730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:07.268072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:07.268513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:07.269270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:07.269696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:07.336918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bd9abde4-7596-4e1b-9a2f-727d4d1ec139 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081050 Nov 24 18:07:07.337467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 637/1274] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:07.699985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:07.700588 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:07.707745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:07.708187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:07.708942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:07.709369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:07.819771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:07.828289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-626d5139-341b-4765-9658-b683aaf9abba tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132019 Nov 24 18:07:07.828843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 638/1275] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:07 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:08.347819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:08.348726 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:08.356454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:08.356898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:08.357671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:08.358098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:08.427584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-32e40ff3-dfdd-4a2c-baf5-d8e51e00c57a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083508 Nov 24 18:07:08.428510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 638/1276] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:08.845374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:08.845916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:08.853469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:08.853906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:08.854652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:08.855078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:08.969564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:08.978419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d10e63d0-93df-4b50-ab8f-e547fcd976ec tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136841 Nov 24 18:07:08.978965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 639/1277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:08 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:09.438986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:09.440040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:09.447848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:09.448297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:09.449062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:09.449489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:09.512229 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6d802bb7-90ad-44f2-af55-616f568a7929 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077016 Nov 24 18:07:09.512769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 639/1278] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:09.995135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:09.995711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:10.002753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:10.003185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:10.003963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:10.004388 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:10.121756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:10.134458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-58bca4cd-46c3-4b59-a22d-b930168d4907 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.143117 Nov 24 18:07:10.135006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 640/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:09 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:10.523878 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:10.524789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:10.531841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:10.532287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:10.533053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:10.533482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:10.596443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c32a2be5-50ea-4e24-9846-a83dd92b5f1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076847 Nov 24 18:07:10.597012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 640/1280] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:11.151738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:11.152360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:11.159437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:11.159902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:11.160653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:11.161075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:11.272869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:11.281274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2c41d0bc-bee5-478f-8002-b3abb0eb67a8 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.133208 Nov 24 18:07:11.281818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 641/1281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:11 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:11.606996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:11.607948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:11.615071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:11.615522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:11.616580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:11.617018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:11.684952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b637ce06-2cac-415d-8176-f7c429a5ed84 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081586 Nov 24 18:07:11.685499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 641/1282] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:12.298459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:12.299060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:12.306917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:12.307352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:12.308135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:12.308561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:12.421439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:12.430419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2b2a56b0-2af4-43da-9d2b-240122b4fc5b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135841 Nov 24 18:07:12.430934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 642/1283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:12 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:12.696057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:12.696970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:12.704109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:12.704556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:12.705321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:12.705762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:12.910637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0b512467-adca-41ae-9350-8765e98914f2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.218290 Nov 24 18:07:12.911182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 642/1284] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:13.447935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:13.448537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:13.455691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:13.456128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:13.456869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:13.457291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:13.572023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:13.580394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-20336f61-06d9-4f11-b8f9-6cc7aeab6535 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137164 Nov 24 18:07:13.580949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 643/1285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:13 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:13.922245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:13.923164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:13.930909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:13.931346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:13.932136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:13.932559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:13.994137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0d086dd8-1cd6-4fc7-b7e3-f680581c8e93 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075809 Nov 24 18:07:13.994664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 643/1286] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:14.597500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:14.598098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:14.605902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:14.606335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:14.607079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:14.607503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:14.718484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:14.727744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a9be72a0-b0e1-4545-a6a2-ddb348ad00bb tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.133894 Nov 24 18:07:14.728291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 644/1287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:14 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:15.005483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:15.006340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:15.015718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:15.016159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:15.016925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:15.017353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:15.082866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0cb67fac-9e9b-48d0-8a07-d28cc6c98333 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081182 Nov 24 18:07:15.083405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 644/1288] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Nov 24 18:07:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:07:15.992884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:15.993504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:16.000590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:16.001036 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:16.001807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:16.002239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:16.094780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:07:16.095708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:16.103421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:16.103893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:16.104662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:16.105090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:16.118989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:16.127830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ebbc2032-d1d0-4014-bd01-61073962310c tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.387006 Nov 24 18:07:16.128391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 645/1289] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:15 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:16.234569 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-63a49a66-f718-49a7-8a36-53925bf84990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action" status: 200 len: 76452 microversion: 2.1 time: 0.143296 Nov 24 18:07:16.235575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 645/1290] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:07:16 2021] POST /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7/action => generated 76452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:07:17.144522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:17.145110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:17.152697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:17.153134 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:17.153889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:17.154314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:17.281292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:17.290266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-64d63dad-b293-4401-8cb3-42bbfad10d52 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.149418 Nov 24 18:07:17.290834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 646/1291] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:17 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:18.308635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:18.309330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:18.317163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:18.317610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:18.318368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:18.318799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:18.433677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:18.442968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f0466002-d60c-4619-a6d1-ec90da3c4f4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138768 Nov 24 18:07:18.443146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 646/1292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:18 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:19.458293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:19.458892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:19.467172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:19.467542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:19.468316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:19.468740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:19.582162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:19.591535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-055e0ba7-2aec-4cc6-95e0-f700e8a1050a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136887 Nov 24 18:07:19.592130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 647/1293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:19 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:20.608549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:20.609094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:20.616158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:20.617241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:20.618010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:20.618454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:20.732657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:20.741060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e71e8e31-d3a2-46f6-bb4b-f624a23f6f96 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136406 Nov 24 18:07:20.743501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 647/1294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:20 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:21.758781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:21.759392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:21.766614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:21.767061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:21.767880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:21.768425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:21.886928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:21.895534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0fd98229-7c58-4cd7-a8f4-76ae3426251f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.141301 Nov 24 18:07:21.896122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 648/1295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:21 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:22.911254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:22.911893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:22.920004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:22.920456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:22.921227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:22.921937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:23.038039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:23.049211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bc022f07-e6c0-4e0d-996f-7fc4626afbff tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.141615 Nov 24 18:07:23.049774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 648/1296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:22 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:24.066192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:24.068025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:24.075996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:24.076441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:24.078187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:24.079736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:24.244007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:24.253112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-77a54d80-9f60-4267-a3a7-b6819b348a31 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.190720 Nov 24 18:07:24.253697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 649/1297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:24 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:25.270154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:25.270764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:25.278833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:25.279283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:25.280088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:25.280525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:25.393089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:25.402241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-064284a3-3be5-477f-ae7a-04baed35c025 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135736 Nov 24 18:07:25.402787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 649/1298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:25 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:26.419885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:26.420446 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:26.427836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:26.428274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:26.429625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:26.430043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:26.539656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:26.548281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3ce18805-0deb-4c98-9a53-cbc2451c69c2 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.132142 Nov 24 18:07:26.548826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 650/1299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:26 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:27.564924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:27.565532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:27.573541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:27.573991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:27.574757 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:27.575190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:27.689630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:27.698834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0ef5ebf1-66da-44e6-af76-a98539f02f0a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.137527 Nov 24 18:07:27.699332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 650/1300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:27 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:28.716383 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:28.716972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:28.724170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:28.724613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:28.725420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:28.725914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:28.838929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:28.847323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a43109ef-f377-4ad0-9875-fa716999b94b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134627 Nov 24 18:07:28.847904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 651/1301] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:28 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:29.863956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:29.864574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:29.872269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:29.872727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:29.873489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:29.873922 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:29.986926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:29.996126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a406dc35-a835-4ef8-956d-cdf11340bb4f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135833 Nov 24 18:07:29.996682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 651/1302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:29 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:31.012936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:31.013567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:31.020757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:31.021193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:31.021936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:31.023097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:31.137102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:31.145425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-13eac2c1-edc3-422a-b1b7-50d33b127fb7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136214 Nov 24 18:07:31.145972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 652/1303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:31 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:32.161495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:32.162101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:32.169407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:32.169853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:32.170614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:32.171047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:32.293058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:32.301926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-df62380f-9740-4e66-ad6e-2a8e634447d7 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.144019 Nov 24 18:07:32.302409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 652/1304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:32 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:07:33.320339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:33.320929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:33.328019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:33.328462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:33.329219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:33.329649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:33.441290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:33.456095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-199038a4-7865-419e-85e9-f63d5ca5746a tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.140174 Nov 24 18:07:33.456667 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 653/1305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:33 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:34.473268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:34.473869 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:34.481894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:34.482335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:34.483094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:34.483530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:34.596189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:34.605253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4553ea39-8e65-410e-9824-0ee6a8c7968d tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135660 Nov 24 18:07:34.605804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 653/1306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:34 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:07:35.622380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:35.622983 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:35.630155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:35.630594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:35.631497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:35.632060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:35.744924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:35.753352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c5446c1d-8795-46c7-8ffd-10aea40eb9a9 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134748 Nov 24 18:07:35.753901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 654/1307] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:35 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:36.769898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:36.770506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:36.777737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:36.778184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:36.778949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:36.779377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:36.894373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:36.903009 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9fc4cbca-3469-404e-a8cf-362a8ba9e2cf tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.136782 Nov 24 18:07:36.903559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 654/1308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:36 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:37.919858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:37.920454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:37.927832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:37.928276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:37.929047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:37.929481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:38.043215 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:38.052047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8254ea77-c9b0-4196-856b-9040d180cf5f tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.135893 Nov 24 18:07:38.052599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 655/1309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:37 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:39.068457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:39.069627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:39.077212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:39.077656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:39.078469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:39.078899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:39.192976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:39.203646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-db3ca359-ef77-4b89-82b7-2fcfd3bede0e tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.138752 Nov 24 18:07:39.204203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 655/1310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:39 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:40.220842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:40.221448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:40.229174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:40.229612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:40.230364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:40.230792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:40.342437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:40.351804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d7e1e5e-2608-459c-be36-44eb8d0ab419 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.134590 Nov 24 18:07:40.352459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 656/1311] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:40 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:41.369262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:41.369866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:41.377048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:41.377495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:41.378261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:41.378694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:41.497159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:41.506625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b153fe72-6240-453b-9cb9-fc17e0c0ce56 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.141010 Nov 24 18:07:41.507504 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 656/1312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:41 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:42.524353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:42.524917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:42.531920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:42.532361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:42.533154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:42.533587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:42.658949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35bf8078de0a44e3ad3f0ffa72306ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38ff3a0728b4c08b344b804e0d1ccad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:07:42.670897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-543b12f8-d9df-4057-8a12-34a540c12d2b tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 200 len: 1350 microversion: 2.1 time: 0.150963 Nov 24 18:07:42.671734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 657/1313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:42 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 1350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:07:43.687554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:07:43.688224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] [instance: 16db57ca-063c-485b-a4a7-4d92fcfbde5a] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:07:43.695380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:43.695867 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:43.696639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:07:43.697074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:07:43.753597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] HTTP exception thrown: Instance 16db57ca-063c-485b-a4a7-4d92fcfbde5a could not be found. Nov 24 18:07:43.754202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] Returning 404 to user: Instance 16db57ca-063c-485b-a4a7-4d92fcfbde5a could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:07:43.755053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-774f0b6d-5429-45a5-851a-ce9d9bf909f6 tempest-VolumesSnapshotTestJSON-336221072 tempest-VolumesSnapshotTestJSON-336221072-project] 10.222.0.64 "GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a" status: 404 len: 111 microversion: 2.1 time: 0.071332 Nov 24 18:07:43.755613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 657/1314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:07:43 2021] GET /compute/v2.1/servers/16db57ca-063c-485b-a4a7-4d92fcfbde5a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:09:09.378594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:09:09.379261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:09:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:09:12.459550 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:09:12.460090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:09:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:09:54.430089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:09:54.430737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:09:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:11:02.486626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:11:02.487104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:11:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:11:07.736435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:11:07.737003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:11:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:11:44.654737 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:44.655368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:44.662375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:11:44.667240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:44.667709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:44.668461 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:44.668878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:44.727939 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:11:44.838179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-affc52d5-bb1f-4f7f-971c-608688eff61b tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 204 len: 0 microversion: 2.1 time: 0.186763 Nov 24 18:11:44.838720 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 658/1315] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:11:44 2021] DELETE /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:11:44.847334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:44.847956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:44.852021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:11:44.856956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:44.857401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:44.858164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:44.858631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:45.241085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:11:45.249148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90aa4c2e-d1ab-4d30-a2ce-3bab850cd7d4 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1514 microversion: 2.1 time: 0.406008 Nov 24 18:11:45.249720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 658/1316] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:44 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:11:46.160224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59724. Nov 24 18:11:46.222516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-0d1af0f9-3dd6-4a13-9b01-7fdaf3c0c874 req-887b925a-0d71-407b-88bd-17373efeabb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a262d0fc-9809-4030-b5f5-3f7d25323e4b", "name": "network-vif-deleted", "tag": "8fa8ced4-236c-4411-8064-df63a3451657"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:11:46.224172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:11:46.224172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:11:46.233218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-0d1af0f9-3dd6-4a13-9b01-7fdaf3c0c874 req-887b925a-0d71-407b-88bd-17373efeabb7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:46.233935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-0d1af0f9-3dd6-4a13-9b01-7fdaf3c0c874 req-887b925a-0d71-407b-88bd-17373efeabb7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:46.251648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-0d1af0f9-3dd6-4a13-9b01-7fdaf3c0c874 req-887b925a-0d71-407b-88bd-17373efeabb7 service nova] Creating event network-vif-deleted:8fa8ced4-236c-4411-8064-df63a3451657 for instance a262d0fc-9809-4030-b5f5-3f7d25323e4b on hv-cinder-81857 Nov 24 18:11:46.263560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-0d1af0f9-3dd6-4a13-9b01-7fdaf3c0c874 req-887b925a-0d71-407b-88bd-17373efeabb7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126472 Nov 24 18:11:46.264869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 659/1317] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:11:46.269244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:46.269943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:46.295909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59730. Nov 24 18:11:46.299331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:46.300027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:46.301013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:46.301435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:46.377151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:46.377700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:46.378249 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lazy-loading 'fault' on Instance uuid a262d0fc-9809-4030-b5f5-3f7d25323e4b {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:11:46.462221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:11:46.470671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cf5db73d-321f-4405-a131-525ced18523a tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 200 len: 1308 microversion: 2.1 time: 0.207556 Nov 24 18:11:46.471233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 659/1318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:46 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:11:47.488255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:47.488940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: a262d0fc-9809-4030-b5f5-3f7d25323e4b] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:47.496223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:47.496656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:47.497401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:47.497823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:47.546137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Instance a262d0fc-9809-4030-b5f5-3f7d25323e4b could not be found. Nov 24 18:11:47.546676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 404 to user: Instance a262d0fc-9809-4030-b5f5-3f7d25323e4b could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:11:47.548025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-68f8d7e8-a25d-46e3-83c7-1434b4f7ee89 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b" status: 404 len: 111 microversion: 2.1 time: 0.063653 Nov 24 18:11:47.548551 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 660/1319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:47 2021] GET /compute/v2.1/servers/a262d0fc-9809-4030-b5f5-3f7d25323e4b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:11:47.556285 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:47.556776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:47.564451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:47.564897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:47.565651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:47.566081 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:47.628383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:11:47.725661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:11:48.742106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [c4b50a07-4f4d-4179-b8c4-b05509dcd168] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 59748. Nov 24 18:11:48.763186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6e89f7b3-0573-4e42-92eb-feb2c7046114 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 204 len: 0 microversion: 2.1 time: 1.210378 Nov 24 18:11:48.763861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 660/1320] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:11:47 2021] DELETE /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 0 bytes in 1212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:11:48.771983 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:48.772588 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:48.779734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:48.780176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:48.780924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:48.781978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:49.032734 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:11:49.040775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e2739b49-cfae-4773-bc17-8b4c022b01fb tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1512 microversion: 2.1 time: 0.272458 Nov 24 18:11:49.041915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 661/1321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:48 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1512 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:11:50.058751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:50.059783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:50.069624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:50.070079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:50.070863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:50.071303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:50.121469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-bd0fff97-3f4b-41a8-be6f-55ee3405f796 req-017a958a-6046-4537-bfae-e9f97e70522f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0e985a-631f-411c-a0ef-97f82f628918", "name": "network-vif-deleted", "tag": "50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:11:50.123227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:11:50.123227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:11:50.139008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-bd0fff97-3f4b-41a8-be6f-55ee3405f796 req-017a958a-6046-4537-bfae-e9f97e70522f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:50.143029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-bd0fff97-3f4b-41a8-be6f-55ee3405f796 req-017a958a-6046-4537-bfae-e9f97e70522f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:50.171148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-bd0fff97-3f4b-41a8-be6f-55ee3405f796 req-017a958a-6046-4537-bfae-e9f97e70522f service nova] Creating event network-vif-deleted:50cbf0cd-dd8f-4778-b627-d6a9cd3fdc3a for instance ed0e985a-631f-411c-a0ef-97f82f628918 on hv-cinder-81857 Nov 24 18:11:50.178847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-bd0fff97-3f4b-41a8-be6f-55ee3405f796 req-017a958a-6046-4537-bfae-e9f97e70522f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060102 Nov 24 18:11:50.179487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 662/1322] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:11:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:11:50.253155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:11:50.261401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2c217862-7692-48f1-ac1c-abe1be712c4c tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 200 len: 1470 microversion: 2.1 time: 0.206773 Nov 24 18:11:50.261959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 661/1323] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:50 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:11:51.278388 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:11:51.279110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: ed0e985a-631f-411c-a0ef-97f82f628918] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:11:51.286544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:51.287007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:51.287792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:11:51.288220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:11:51.338085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Instance ed0e985a-631f-411c-a0ef-97f82f628918 could not be found. Nov 24 18:11:51.338674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 404 to user: Instance ed0e985a-631f-411c-a0ef-97f82f628918 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:11:51.339491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d476de5-ff93-405d-bfd1-f61685ea70fc tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918" status: 404 len: 111 microversion: 2.1 time: 0.065243 Nov 24 18:11:51.340071 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 663/1324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:11:51 2021] GET /compute/v2.1/servers/ed0e985a-631f-411c-a0ef-97f82f628918 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:12:29.398097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:12:29.398687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:12:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:12:32.482163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:12:32.482691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:12:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:13:14.449100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:13:14.449839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:13:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:13:16.494458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:16.495017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:16.502347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:16.502791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:16.503562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:16.504021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:16.568699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:13:16.705100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-00a22e15-eb0d-4b31-aa51-bfab708265b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 204 len: 0 microversion: 2.1 time: 0.214117 Nov 24 18:13:16.707062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 662/1325] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:13:16 2021] DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:13:16.717342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:16.718479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:16.727210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:16.727681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:16.728773 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:16.729198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:16.949893 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:16.959450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-266b5b9a-2038-44aa-a466-3e0aa6aff530 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1716 microversion: 2.1 time: 0.246807 Nov 24 18:13:16.960045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 664/1326] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:17.979158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:17.979888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:17.987024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:17.987478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:17.988289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:17.988724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:18.539858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:18.548774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-46266c74-24b8-4259-bcea-ff8dd321e267 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1716 microversion: 2.1 time: 0.574349 Nov 24 18:13:18.549340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 663/1327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1716 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:19.151692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-335ce35e-a361-46a6-90fa-c5786e74b6e9 req-5e0815b3-8459-4e3d-917f-fbb24e6779a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f00b1d-a746-4496-a338-1a6ca81f15c7", "name": "network-vif-deleted", "tag": "ba45d7ce-4681-4fd8-b019-1ea1b0526b2b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:13:19.153431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:13:19.153431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:13:19.161688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-335ce35e-a361-46a6-90fa-c5786e74b6e9 req-5e0815b3-8459-4e3d-917f-fbb24e6779a0 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:19.162125 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-335ce35e-a361-46a6-90fa-c5786e74b6e9 req-5e0815b3-8459-4e3d-917f-fbb24e6779a0 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:19.186364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-335ce35e-a361-46a6-90fa-c5786e74b6e9 req-5e0815b3-8459-4e3d-917f-fbb24e6779a0 service nova] Creating event network-vif-deleted:ba45d7ce-4681-4fd8-b019-1ea1b0526b2b for instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 on hv-cinder-81857 Nov 24 18:13:19.191894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-335ce35e-a361-46a6-90fa-c5786e74b6e9 req-5e0815b3-8459-4e3d-917f-fbb24e6779a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044868 Nov 24 18:13:19.192599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 665/1328] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:13:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:13:19.572022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:19.572910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:19.582648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:19.583093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:19.583900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:19.584338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:19.717822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:19.727014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-071d84dd-85c3-44a4-bfdb-2074c3c7fdc3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.162434 Nov 24 18:13:19.727829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 664/1329] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:20.743703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:20.744392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:20.751961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:20.752401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:20.753165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:20.753589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:20.867176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:20.876538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c7492f65-301e-4f90-a780-0d4c082aad64 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136449 Nov 24 18:13:20.876538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 666/1330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:21.893559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:21.894186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:21.902404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:21.902838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:21.903613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:21.904050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:22.024881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:22.033552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ae7d1c01-c8e4-45e9-957c-56bd8c57f5f4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.143655 Nov 24 18:13:22.034316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 665/1331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:13:23.051289 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:23.051927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:23.060048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:23.060638 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:23.061184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:23.061611 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:23.173877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:23.182864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-538d62ec-ef40-4cde-bf82-061c68e07228 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.135482 Nov 24 18:13:23.183472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 667/1332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:24.200999 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:24.201830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:24.209491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:24.210105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:24.211680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:24.212114 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:24.334664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:24.344914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-03b77a44-655c-4e0b-a48c-58a688cdcc5f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.147552 Nov 24 18:13:24.345488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 666/1333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:25.361426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:25.362049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:25.369173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:25.369608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:25.370353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:25.370830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:25.493273 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:25.502268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d76bd6c6-fc04-4f50-922c-61686d2c9e43 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144550 Nov 24 18:13:25.502836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 668/1334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:26.520069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:26.520997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:26.529160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:26.529647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:26.531109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:26.532017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:26.650775 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:26.659387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2b0f4dce-40f2-4c01-999c-76aaa496c0cc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.143189 Nov 24 18:13:26.659989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 667/1335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:26 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:27.677263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:27.677874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:27.685677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:27.686142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:27.686904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:27.687334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:27.811632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:27.820864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8de89b05-2b6f-4553-b320-9a135287ff15 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.147248 Nov 24 18:13:27.821669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 669/1336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:28.838173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:28.838863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:28.846389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:28.846829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:28.847588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:28.848045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:28.970422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:28.981357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e1ef9ff5-9133-4258-ac91-77986d3f9768 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146807 Nov 24 18:13:28.982145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 668/1337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:29.998454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:29.999142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:30.006655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:30.007844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:30.008723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:30.009157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:30.126513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:30.135547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5b0fab5b-560f-4946-8ef2-73a4cec92e4a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140695 Nov 24 18:13:30.136148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 670/1338] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:31.154112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:31.154728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:31.162334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:31.162779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:31.163560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:31.164021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:31.282587 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:31.291469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-44b3144d-5b35-40cb-9cb0-7ae3d69ccb60 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140926 Nov 24 18:13:31.292073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 669/1339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:13:32.308023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:32.308601 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:32.316188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:32.316612 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:32.317368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:32.317792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:32.443250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:32.453065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3dff8d47-0022-49b3-8e46-6a8b314d5769 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.149010 Nov 24 18:13:32.453858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 671/1340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:33.470162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:33.470770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:33.479297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:33.479786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:33.480560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:33.480998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:33.594532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:33.604157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-06d4c6e8-251f-435d-a510-cd3874cfc594 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.137672 Nov 24 18:13:33.604724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 670/1341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:34.621838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:34.622578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:34.629679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:34.630120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:34.630874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:34.631587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:34.747775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:34.756634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9dea95e5-0ae8-46c7-8560-86296aec0409 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.138457 Nov 24 18:13:34.757261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 672/1342] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:34 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:35.773767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:35.774560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:35.781883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:35.782327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:35.783105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:35.783538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:35.901139 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:35.910621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bc6cdcb3-0b68-46ff-95d9-97bae6ab989c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140665 Nov 24 18:13:35.911194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 671/1343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:36.930307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:36.931003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:36.938355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:36.938794 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:36.939557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:36.940011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:37.058627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:37.067393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b2282c5a-2474-4868-8fdd-78e11b1b3125 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142021 Nov 24 18:13:37.067989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 673/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:38.084621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:38.086449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:38.093080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:38.093520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:38.094283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:38.094707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:38.212440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:38.222187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1fdeef43-2709-47f0-8f60-5d3d90d03599 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140358 Nov 24 18:13:38.227313 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 672/1345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:39.238510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:39.239282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:39.248781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:39.249268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:39.249934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:39.250363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:39.457181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:39.468189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-906c8565-8397-4af9-93ba-44eb73903332 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.233632 Nov 24 18:13:39.468755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 674/1346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:40.485252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:40.485843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:40.494297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:40.494743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:40.495525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:40.495988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:40.610212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:40.619802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9c1f260d-6e18-4d4f-ba02-68135a60e649 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.138124 Nov 24 18:13:40.620512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 673/1347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:41.637679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:41.638306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:41.647745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:41.648803 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:41.649613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:41.650048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:41.782423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:41.791641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0427929e-7455-472a-a940-4b1a02039890 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.157725 Nov 24 18:13:41.792216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 675/1348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:41 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:42.809791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:42.810497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:42.819084 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:42.819516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:42.820840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:42.822130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:42.941729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:42.951264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f0949453-e350-4db7-aa69-34edfe798505 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146723 Nov 24 18:13:42.951851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 674/1349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:43.968268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:43.968903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:43.976100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:43.977284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:43.978005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:43.978435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:44.095371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:44.105073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-823274a3-0063-480b-9a5a-af7178bc6c92 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140358 Nov 24 18:13:44.105643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 676/1350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:45.125389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:45.126039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:45.134072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:45.134519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:45.135293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:45.135763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:45.254202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:45.270170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fc1dfb39-a0b2-46cc-bcda-977ada204434 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.148353 Nov 24 18:13:45.270769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 675/1351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:46.287271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:46.287935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:46.296322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:46.296766 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:46.297531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:46.298214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:46.433627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:46.443581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d7e8f959-9e3c-4d8c-969b-da1e214f1110 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.159364 Nov 24 18:13:46.443581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 677/1352] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:47.462863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:47.463449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:47.471077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:47.471519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:47.472331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:47.472758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:47.588886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:47.598443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8e545e6-f410-4273-b642-cd6a83468625 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.139754 Nov 24 18:13:47.598933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 676/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:47 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:48.615891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:48.616495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:48.624358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:48.624807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:48.625579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:48.626014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:48.739985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:48.749592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9886fe74-ed18-4035-8025-71c221fba40b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.137322 Nov 24 18:13:48.750165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 678/1354] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:13:49.767830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:49.768423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:49.776382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:49.776822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:49.777597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:49.778032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:49.901281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:49.911097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-13930b59-1368-4920-8ef7-c6709956c9cd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146862 Nov 24 18:13:49.911705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 677/1355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:50.928888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:50.930044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:50.937483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:50.937919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:50.938674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:50.939098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:51.054281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:51.063541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c375000f-59bf-4228-92d2-7ed4c5eca158 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.138235 Nov 24 18:13:51.064131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 679/1356] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:52.081281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:52.081850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:52.089476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:52.089919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:52.090681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:52.091117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:52.240046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:52.249851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bfa0814c-c18d-4f69-81bc-f215c2dbbb28 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.172472 Nov 24 18:13:52.250425 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 678/1357] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:53.267336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:53.267999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:53.275287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:53.275768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:53.276529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:53.276966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:53.395642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:53.405178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e6a597b4-5dd4-4830-9441-b326c142f2f9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.141563 Nov 24 18:13:53.405722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 680/1358] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:54.423925 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:54.424806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:54.432821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:54.433269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:54.434083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:54.434594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:54.590187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:54.598823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-30879cc4-bdf8-4438-a1b3-18db051caa36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.180287 Nov 24 18:13:54.599648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 679/1359] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:54 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:55.617100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:55.617805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:55.624985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:55.625427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:55.626191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:55.626617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:55.739945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:55.749380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2e057957-b7d2-40f2-aa26-0e6157576ad2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136373 Nov 24 18:13:55.749998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 681/1360] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:56.768364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:56.768981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:56.777510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:56.777959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:56.778749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:56.779185 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:56.907298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:56.916831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7ba209f7-a1c3-4021-be5f-2bda7275f007 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152194 Nov 24 18:13:56.917464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 680/1361] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:57.934493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:57.935098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:57.942310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:57.942752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:57.943511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:57.943963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:58.056552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:58.065343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-417ee25e-e215-495b-84fe-127259c05f76 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.134652 Nov 24 18:13:58.065897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 682/1362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:13:59.082503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:13:59.083104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:13:59.091064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:59.091533 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:59.092381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:13:59.092822 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:13:59.205646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:13:59.214918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-70df1044-83b6-4b88-8dfe-9b3dfedee047 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136070 Nov 24 18:13:59.215495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 681/1363] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:13:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:00.232008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:00.232606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:00.239836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:00.240274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:00.241063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:00.241488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:00.378011 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:00.390739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-325961d8-05af-4a78-9997-aa61cef0d593 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.162203 Nov 24 18:14:00.391323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 683/1364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:01.407482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:01.408170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:01.416520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:01.416989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:01.417758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:01.420377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:01.535462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:01.544794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-49c6837b-0c40-48b8-a94f-8f68131c17ed tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140860 Nov 24 18:14:01.545363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 682/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:01 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:02.562434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:02.563027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:02.570047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:02.570482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:02.571548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:02.572072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:02.702393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:02.711001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5df1e37e-a40c-4cd3-be91-c0e77f3af042 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152686 Nov 24 18:14:02.712901 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 684/1366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:03.729732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:03.730387 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:03.737631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:03.738072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:03.738834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:03.739262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:03.860682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:03.869740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1de1cea1-21d9-4c6f-b89b-542edd8cf15c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144270 Nov 24 18:14:03.870326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 683/1367] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:04.888352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:04.888969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:04.896364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:04.896802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:04.897566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:04.897996 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:05.020665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:05.030386 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-60767f35-2126-400c-bbc9-3747f6a955d3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146403 Nov 24 18:14:05.030930 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 685/1368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:06.047846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:06.048699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:06.058871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:06.059365 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:06.060211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:06.060652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:06.182291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:06.190876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-af10f156-19fa-431d-a562-5a684338666d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146590 Nov 24 18:14:06.191442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 684/1369] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:07.208472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:07.209082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:07.216463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:07.216906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:07.217673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:07.218109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:07.347644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:07.357045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1358562a-4e7b-480e-8142-fb646ec188cf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152228 Nov 24 18:14:07.357595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 686/1370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:08.373989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:08.374664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:08.382314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:08.382768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:08.383571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:08.384156 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:08.503799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:08.512773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cf218e4b-8349-4a5c-aef6-3a136ef443c9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142799 Nov 24 18:14:08.513333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 685/1371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:08 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:09.530041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:09.530610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:09.541441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:09.541968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:09.542892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:09.543363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:09.668361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:09.677279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-92dec810-80f1-428e-a54f-a46809ca7897 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.150936 Nov 24 18:14:09.677838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 687/1372] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:10.694770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:10.695324 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:10.703409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:10.703881 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:10.704758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:10.705189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:10.825038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:10.833667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-92a79ded-b7b1-4b4d-9b2e-e625ff4672d1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142814 Nov 24 18:14:10.834225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 686/1373] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:11.850493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:11.851101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:11.858852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:11.859296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:11.860089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:11.860519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:11.972085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:11.981295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c2743fe7-69e7-4ecb-a0aa-af3942a66475 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.134470 Nov 24 18:14:11.981859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 688/1374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:12.999853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:13.000923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:13.010244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:13.010690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:13.011590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:13.012160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:13.136417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:13.150344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-800b61c5-58ac-450c-9c12-33825599b420 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.154501 Nov 24 18:14:13.150951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 687/1375] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:14.178932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:14.179552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:14.187629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:14.188093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:14.188862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:14.189320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:14.308509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:14.317264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f719ac65-aeb7-467b-80cd-581e8b043825 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142061 Nov 24 18:14:14.317827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 689/1376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:15.334524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:15.335156 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:15.344382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:15.344828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:15.345603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:15.346038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:15.458163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:15.467370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6c348f21-a106-47b2-b741-6ff3342425d7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136855 Nov 24 18:14:15.467960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 688/1377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:15 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:16.484943 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:16.485543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:16.493382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:16.494217 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:16.494802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:16.495227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:16.608750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:16.617353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cdba800c-bc2d-4421-a8e9-43d00f0847d2 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136592 Nov 24 18:14:16.618544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 690/1378] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:17.636034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:17.636652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:17.644289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:17.644732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:17.645490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:17.645924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:17.767459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:17.777325 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b67059bc-1453-4c1f-a814-deea95151463 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.145986 Nov 24 18:14:17.777889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 689/1379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:14:18.794732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:18.795364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:18.802781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:18.803226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:18.804021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:18.804453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:18.918280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:18.927382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a70851c8-7c89-4016-8cf7-627d2a075d0b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136294 Nov 24 18:14:18.927972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 691/1380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:19.945626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:19.946513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:19.954274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:19.954756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:19.955548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:19.956034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:20.076137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:20.085043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-840021c2-97ec-4e40-a113-9570852b8f77 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.143863 Nov 24 18:14:20.085603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 690/1381] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:14:21.102994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:21.103619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:21.111138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:21.111622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:21.112392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:21.112819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:21.232363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:21.241014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-52403998-d0cf-4783-8c4f-62a7f43de8d8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142408 Nov 24 18:14:21.241565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 692/1382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:21 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:22.258005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:22.259585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:22.266697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:22.267141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:22.267947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:22.268378 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:22.384827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:22.393644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dfc3ce09-84ab-4bd9-b592-eba8d47bc990 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.139327 Nov 24 18:14:22.394214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 691/1383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:22 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:22.503756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:14:22.503971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:14:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:14:23.410573 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:23.411157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:23.419757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:23.420188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:23.420945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:23.421368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:23.681791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:23.690296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-43b2b936-6413-401b-9750-eee5348fc569 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.283313 Nov 24 18:14:23.690843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 693/1384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:23 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:24.705823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:24.706419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:24.713675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:24.714113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:24.714861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:24.715290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:24.833011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:24.841970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1d37997e-90a0-4614-be6f-dd09bbf331fe tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.139683 Nov 24 18:14:24.843648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 692/1385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:25.858394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:25.859132 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:25.866258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:25.866718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:25.867458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:25.868378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:25.987130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:25.995643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-378456ad-708f-4e01-bba2-f154bb70352b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140902 Nov 24 18:14:25.996189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 694/1386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:25 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:27.012843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:27.013595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:27.020841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:27.021315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:27.022112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:27.022568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:27.140548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:27.149940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-27a6a51b-4b6c-4953-b07c-54a5df0a751c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140701 Nov 24 18:14:27.150577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 693/1387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:27 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:28.166567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:28.167203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:28.174657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:28.175047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:28.176007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:28.176543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:28.307798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:28.316407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ec5a513f-f514-44d3-b065-571a27fae783 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.154088 Nov 24 18:14:28.316950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 695/1388] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:28 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:29.333568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:29.334182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:29.342279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:29.342713 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:29.343503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:29.343966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:29.460788 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:29.470476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3396d6df-d9ea-4e79-8924-7290461751e1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140568 Nov 24 18:14:29.471036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 694/1389] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:29 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:30.488336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:30.488891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:30.498120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:30.498340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:30.498955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:30.499386 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:30.621659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:30.631236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-17b9623f-213e-4503-adc7-776c1cfc037c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146622 Nov 24 18:14:30.631826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 696/1390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:30 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:31.651625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:31.652329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:31.659974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:31.660416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:31.661194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:31.661620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:31.787272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:31.796567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8396b844-e26b-44a7-bbc5-9d24781b3642 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.149390 Nov 24 18:14:31.797144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 695/1391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:31 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:32.813307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:32.813897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:32.822340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:32.822953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:32.824198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:32.824818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:32.959829 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:32.970081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a23e045f-c846-414e-920c-50038e61fe36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.160597 Nov 24 18:14:32.970658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 697/1392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:32 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:14:33.990576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:33.991195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:33.999287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:33.999761 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:34.000571 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:34.001061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:34.134603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:34.143804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a7f1975d-627e-4407-a1a6-6b73fc018b44 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.159607 Nov 24 18:14:34.144373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 696/1393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:33 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:35.162449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:35.163051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:35.173707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:35.174142 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:35.174911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:35.175340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:35.299961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:35.310181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1b610f2b-197c-4b1c-97d0-1d3e6635831e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152179 Nov 24 18:14:35.310748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 698/1394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:35 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:36.332259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:36.333079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:36.344052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:36.344720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:36.345785 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:36.346323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:36.467460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:36.477134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c02c7f23-1a75-41a1-82ba-4e2b73b5a4b4 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.149887 Nov 24 18:14:36.478463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 697/1395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:36 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:37.496623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:37.497474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:37.509330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:37.509774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:37.510630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:37.511056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:37.632393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:37.642149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-af2c24d4-c10f-468b-97fa-eb9c465bc229 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.150909 Nov 24 18:14:37.642728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 699/1396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:37 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:38.660683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:38.661350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:38.669976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:38.670421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:38.671256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:38.671725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:38.794348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:38.807567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cf3bea36-4d7a-4c35-902f-bcd23505f640 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.150480 Nov 24 18:14:38.808313 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 698/1397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:38 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:39.832971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:39.833632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:39.841793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:39.842264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:39.843029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:39.843454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:39.960557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:39.969851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fbc06f54-cbf9-4947-be97-9ded10e40d08 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140495 Nov 24 18:14:39.970423 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 700/1398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:39 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:40.987055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:40.987687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:40.995173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:40.995645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:40.996417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:40.996846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:41.185259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:41.194182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6a05da84-eb31-4006-8f76-50c4fa1b0699 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.210726 Nov 24 18:14:41.194749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 699/1399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:40 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:14:42.217170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:42.217778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:42.225101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:42.225545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:42.226823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:42.227216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:42.349076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:42.360384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-50a683bd-4c1b-4318-bbbd-a20557080d5b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.147363 Nov 24 18:14:42.360953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 701/1400] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:42 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:43.380574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:43.381237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:43.390148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:43.390628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:43.391419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:43.392178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:43.520891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:43.530276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3dfe53a0-73e5-46e0-8e06-71005c70b1ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.154715 Nov 24 18:14:43.530851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 700/1401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:43 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:44.552917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:44.553962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:44.563212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:44.563678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:44.564469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:44.565078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:44.687307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:44.702117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dfb23523-c19d-4cd4-9706-ebdf81c08c2f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.156277 Nov 24 18:14:44.706539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 702/1402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:44 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:45.727748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:45.728488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:45.736065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:45.736554 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:45.737447 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:45.737884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:45.891385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:45.906675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dcd98643-ded8-4411-bc22-626040c4ab46 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.183085 Nov 24 18:14:45.914383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 701/1403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:45 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:46.922225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Nov 24 18:14:46.925858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:46.926489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:46.934850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:46.935292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:46.936095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:46.936522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:47.056675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:47.066031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b2623333-b5a6-49c1-92ec-e7f68e897cc6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144881 Nov 24 18:14:47.066605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 703/1404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:46 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:48.081959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:48.082620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:48.086070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:14:48.091254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:48.091729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:48.092499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:48.092968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:48.211006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:48.228253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4d9b4f02-e170-4d2f-b139-dc76c0a6df22 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.149432 Nov 24 18:14:48.228830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 702/1405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:48 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:49.247293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:49.248222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:49.266202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:49.266640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:49.267420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:49.267867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:49.322662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 32896. Nov 24 18:14:49.391460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:49.400285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b961ba2f-1742-4608-90d4-ef31b687b8e6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.157826 Nov 24 18:14:49.401336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 704/1406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:49 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:50.419113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:50.419770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:50.438832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:50.439283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:50.440109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:50.440544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:50.495667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 32906. Nov 24 18:14:50.564121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:50.573832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0faca298-c251-4365-928a-271160e523ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.159498 Nov 24 18:14:50.574420 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 703/1407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:50 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:51.593309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:51.594060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:51.603315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:51.603866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:51.605195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:51.605630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:51.723702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:51.733563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-446d8605-1c86-4853-846c-90fbb8447190 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146142 Nov 24 18:14:51.734137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 705/1408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:51 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:52.752086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:52.752683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:52.760957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:52.761564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:52.762476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:52.762915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:52.893131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:52.904961 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-80238ca1-128e-477d-bd84-b1455999514f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.157917 Nov 24 18:14:52.905455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 704/1409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:52 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:14:53.924453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:53.924994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:53.935518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:53.935995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:53.936775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:53.937200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:54.062919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:54.072219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-92b90d7c-9cb3-4f17-8d3a-3dab2c142842 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152906 Nov 24 18:14:54.073532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 706/1410] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:53 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:55.093246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:55.094327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:55.105879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:55.106422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:55.107489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:55.107948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:55.229635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:55.239488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-014f8d72-0984-4745-849a-b0105e118bc9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.152750 Nov 24 18:14:55.240140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 705/1411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:55 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:56.259735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:56.261785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:56.271343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:56.272049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:56.273114 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:56.273832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:56.406335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:56.421751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4b53db5f-f4b6-49d8-9b8b-c11401f6993e tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.165454 Nov 24 18:14:56.422589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 707/1412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:56 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:57.444956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:57.445570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:57.454536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:57.454973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:57.455779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:57.456210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:57.579123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:57.592163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ad91db19-2ed3-4b4e-b5ac-85d69535e478 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.150909 Nov 24 18:14:57.592750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 706/1413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:57 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:58.609122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:58.609761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:58.617463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:58.617894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:58.618655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:58.619075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:58.747507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:58.759539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e86aa900-5ff4-4959-8944-abcab4178470 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.154630 Nov 24 18:14:58.760260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 708/1414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:58 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:14:59.777330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:14:59.779017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:14:59.786739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:59.787188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:59.787985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:14:59.788416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:14:59.945362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:14:59.955734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-17a3c6fa-5beb-4ea2-ab46-d5d20c32898b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.182112 Nov 24 18:14:59.956310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 707/1415] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:14:59 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:00.975133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:00.976021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:00.984683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:00.985132 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:00.985922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:00.986354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:01.105658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:01.115780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-716b0709-a268-4f92-aa74-f6e0bea63452 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146414 Nov 24 18:15:01.116344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 709/1416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:00 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:02.133035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:02.133632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:02.141502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:02.141938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:02.142704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:02.143134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:02.257930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:02.267648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-faddca97-9ae4-41cd-811d-b207ec66f250 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.138450 Nov 24 18:15:02.268231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 708/1417] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:02 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:03.284577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:03.285181 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:03.292359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:03.292801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:03.294130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:03.294636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:03.415868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:03.425712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-02a58b21-9903-4d0d-ad75-212df67b75a7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144713 Nov 24 18:15:03.426291 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 710/1418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:03 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:04.443464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:04.444129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:04.452041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:04.452491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:04.453265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:04.453700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:04.571800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:04.581573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d6cabef2-f909-4212-bb4b-ce0f4a9a6235 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.141794 Nov 24 18:15:04.582336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 709/1419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:04 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:05.599089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:05.599665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:05.607564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:05.608026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:05.608782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:05.609206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:05.722807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:05.734559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-089d6eab-96b5-4441-9445-5b23d5368535 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136700 Nov 24 18:15:05.734905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 711/1420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:05 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:06.751692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:06.752211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:06.759907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:06.760352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:06.761121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:06.761549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:06.877696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:06.886264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-269192d9-9ffa-4d4b-adaf-a551a2761e1f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.138390 Nov 24 18:15:06.886862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 710/1421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:06 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:15:07.903758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:07.904468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:07.911575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:07.912042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:07.912813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:07.913232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:08.027211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:08.036498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-05829394-8e67-481f-97df-bdf104530be9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136982 Nov 24 18:15:08.037042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 712/1422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:07 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:09.054406 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:09.055134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:09.062988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:09.063440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:09.064242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:09.064672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:09.178104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:09.187699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ac8abe2-2b94-4296-a6c3-caf94e4a7b55 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.136890 Nov 24 18:15:09.188268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 711/1423] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:09 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:10.204909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:10.205529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:10.212880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:10.213325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:10.214102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:10.214531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:10.334131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:10.343364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fc305e64-3e8b-4f8c-8271-7ae930c6f3ff tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.142117 Nov 24 18:15:10.343944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 713/1424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:10 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:11.364800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:11.365459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:11.373465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:11.373819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:11.374604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:11.375037 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:11.494194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:11.503419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a9663900-d619-45c1-8c88-53354a182b01 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.146725 Nov 24 18:15:11.504035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 712/1425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:11 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:12.520481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:12.521088 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:12.528925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:12.529361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:12.530122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:12.530542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:12.648069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:12.657479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6711f813-1fb6-4c9c-9c30-fbc0ddff6fcf tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.140611 Nov 24 18:15:12.658033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 714/1426] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:12 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:13.679654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:13.680524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:13.693695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:13.694430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:13.695654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:13.696299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:13.858582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:13.867375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b9a4d5d8-e241-4379-a229-4e51d32b271d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.194579 Nov 24 18:15:13.867966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 713/1427] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:13 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:14.884388 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:14.885000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:14.892657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:14.893100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:14.893866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:14.894301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:15.011624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:15.020479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dea98931-eb02-45f6-bcdb-05ba1b224bae tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.139799 Nov 24 18:15:15.021048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 715/1428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:14 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:16.038396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:16.039061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:16.050023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:16.050830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:16.052089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:16.052530 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:16.169266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:16.178375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c5a60fdc-cb89-48ee-aa59-7788480d8ff9 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144393 Nov 24 18:15:16.178952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 714/1429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:16 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:17.194988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:17.195636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:17.203670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:17.204113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:17.204877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:17.205309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:17.326400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:17.336252 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a825deb6-2523-4893-ac03-b90ff67d71f3 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.144896 Nov 24 18:15:17.336826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 716/1430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:17 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:18.356828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:18.357480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:18.364815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:18.365259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:18.366030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:18.366458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:18.553443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:18.562437 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7ade7e63-277b-4e35-836b-0b0c33fe383b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1366 microversion: 2.1 time: 0.209855 Nov 24 18:15:18.563005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 715/1431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:18 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:19.580048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:19.581081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:19.593933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:19.594661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:19.595964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:19.596682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:19.676667 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:19.677105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:19.677554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lazy-loading 'fault' on Instance uuid 38f00b1d-a746-4496-a338-1a6ca81f15c7 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:15:19.734264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:19.742963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9103621b-a19d-40c3-9b55-ff061efbac66 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 200 len: 1460 microversion: 2.1 time: 0.167938 Nov 24 18:15:19.743522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 717/1432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:19 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 1460 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:20.760398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:20.761015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:20.769972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:20.770415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:20.771194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:20.771644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:20.827152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. Nov 24 18:15:20.827792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:15:20.828608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cd6ed084-c001-4bb6-ba26-c85a1a1b56ce tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 404 len: 111 microversion: 2.1 time: 0.071972 Nov 24 18:15:20.829159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 716/1433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:20 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:15:20.837490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cbec669e-9730-4bbd-bb73-51019dbe3803 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '.version_select at 0x7f8b10ab3e50>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:20.859895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cbec669e-9730-4bbd-bb73-51019dbe3803 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551926811" status: 202 len: 0 microversion: 2.1 time: 0.026023 Nov 24 18:15:20.860469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 718/1434] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Nov 24 18:15:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551926811 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:15:22.142728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'create', calling method: .version_select at 0x7f8b101a2790>, body: {"keypair": {"name": "tempest-keypair-137535657"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:22.166038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:22.175064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:22.576855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:22.580948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:22.594651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-741f86c9-143a-407f-b11c-b768d01f5154 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.455911 Nov 24 18:15:22.595245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 717/1435] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Nov 24 18:15:22 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:24.547621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-92202505", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16d04825-809e-487e-b2a8-9c8ebe5605d4"}], "security_groups": [{"name": "tempest-securitygroup--434572353"}], "key_name": "tempest-keypair-137535657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:24.663783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] validate_networks() for [('16d04825-809e-487e-b2a8-9c8ebe5605d4', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:15:25.255909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:15:25.256327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:15:25.256790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:15:25.257223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:15:25.257626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:15:25.266168 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:25.266599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:25.267389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:25.267909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:25.285749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:15:25.289799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Getting quotas for user 7737fd07eb864a5ba258d1892474542f and project 4275b2353e804c9e9365d6f9ff69fb04. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:15:25.301572 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:15:25.303900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:15:25.363219 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6b11b4fd-82a9-4fa5-8c29-0281524eea12 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.819682 Nov 24 18:15:25.363781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 719/1436] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:15:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:15:25.377165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-00b02e3a-ce58-4fab-bc20-eaea24466f36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:25.377904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-00b02e3a-ce58-4fab-bc20-eaea24466f36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:25.486981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-00b02e3a-ce58-4fab-bc20-eaea24466f36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:25.492409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-00b02e3a-ce58-4fab-bc20-eaea24466f36 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1235 microversion: 2.1 time: 0.121588 Nov 24 18:15:25.492994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 718/1437] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:25 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1235 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:26.510653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:26.511692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:26.520852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:26.521925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:26.522957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:26.523796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:26.652402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:26.661592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ca7f7697-83fa-4a51-b004-ed264cfd3316 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1287 microversion: 2.1 time: 0.155218 Nov 24 18:15:26.662916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 720/1438] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:26 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:27.681100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:27.681809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:27.691903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:27.692468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:27.693803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:27.694442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:28.211140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:28.220709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-24381d1b-e8d2-4b48-aa09-99ea7e7e7db8 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.543757 Nov 24 18:15:28.221458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 719/1439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:27 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:28.935793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-28ad6662-65d1-425d-855d-5a0a2ddab436 req-82ab40d4-9a59-44a8-b0f4-8b9c1ca551ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1dcde-4d03-4fde-b034-be9d70cd2aa4", "tag": "3cb4783c-6d29-4fbc-af98-6c3ee3207737"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:28.938542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:28.938542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:15:28.950691 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-28ad6662-65d1-425d-855d-5a0a2ddab436 req-82ab40d4-9a59-44a8-b0f4-8b9c1ca551ea service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:28.951686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-28ad6662-65d1-425d-855d-5a0a2ddab436 req-82ab40d4-9a59-44a8-b0f4-8b9c1ca551ea service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:28.974413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-28ad6662-65d1-425d-855d-5a0a2ddab436 req-82ab40d4-9a59-44a8-b0f4-8b9c1ca551ea service nova] Creating event network-changed:3cb4783c-6d29-4fbc-af98-6c3ee3207737 for instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 on hv-cinder-81857 Nov 24 18:15:28.979483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-28ad6662-65d1-425d-855d-5a0a2ddab436 req-82ab40d4-9a59-44a8-b0f4-8b9c1ca551ea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049198 Nov 24 18:15:28.981459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 721/1440] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:29.238756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:29.239809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:29.248661 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:29.249113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:29.249940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:29.250385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:29.752626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:29.761887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8eb1b448-b66d-4f10-b561-522b378ec4b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.526934 Nov 24 18:15:29.762553 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 720/1441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:29 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:30.780736 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:30.781437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:30.789334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:30.789770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:30.790537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:30.790947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:31.009849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:31.019497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7caedf95-f57e-4f7d-a59b-e38bfc3603bd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.243544 Nov 24 18:15:31.020091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 722/1442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:30 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:32.042975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:32.044205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:32.051213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:32.051686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:32.052481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:32.052907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:32.269255 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:32.278407 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3e4d4cc0-a7b3-4b18-84a7-fbaa63d51e52 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.239619 Nov 24 18:15:32.278972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 721/1443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:32 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:33.294926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:33.295878 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:33.303355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:33.303827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:33.304585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:33.305009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:33.530522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:33.544442 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1d33fdba-96c7-42f3-a7d4-3693a698b3b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.252841 Nov 24 18:15:33.545656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 723/1444] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:33 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:34.564638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:34.565309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:34.572460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:34.572901 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:34.573704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:34.574241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:34.784980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:34.794358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ede1320e-6b27-4b3c-b073-388f02922a3b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.233243 Nov 24 18:15:34.795147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 722/1445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:34 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:35.036432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-4d7bfcb0-d564-499a-b36b-ca5d3c6eba9f req-702607bf-c176-496e-895c-6dbebe8d28b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1dcde-4d03-4fde-b034-be9d70cd2aa4", "name": "network-vif-plugged", "status": "completed", "tag": "3cb4783c-6d29-4fbc-af98-6c3ee3207737"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:35.038355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:35.038355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:15:35.051444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-4d7bfcb0-d564-499a-b36b-ca5d3c6eba9f req-702607bf-c176-496e-895c-6dbebe8d28b4 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:35.052077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-4d7bfcb0-d564-499a-b36b-ca5d3c6eba9f req-702607bf-c176-496e-895c-6dbebe8d28b4 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:35.068852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-4d7bfcb0-d564-499a-b36b-ca5d3c6eba9f req-702607bf-c176-496e-895c-6dbebe8d28b4 service nova] Creating event network-vif-plugged:3cb4783c-6d29-4fbc-af98-6c3ee3207737 for instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 on hv-cinder-81857 Nov 24 18:15:35.073828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-4d7bfcb0-d564-499a-b36b-ca5d3c6eba9f req-702607bf-c176-496e-895c-6dbebe8d28b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099886 Nov 24 18:15:35.074426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 724/1446] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:35.812054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:35.812666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:35.819964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:35.820408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:35.821221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:35.821653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:36.041028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:36.050526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-614d4bac-35b0-4d65-9419-27c3683a5837 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1360 microversion: 2.1 time: 0.242311 Nov 24 18:15:36.051105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 723/1447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:35 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:37.069060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:37.069752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:37.077811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:37.078241 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:37.079008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:37.079432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:37.296351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:15:37.305455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d979c692-f0ff-426c-b5c4-206a734e652c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1544 microversion: 2.1 time: 0.240471 Nov 24 18:15:37.306027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 725/1448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:15:37 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1544 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:15:37.322112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:15:37.322649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:37.333650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:37.334155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:37.334950 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:37.335386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:37.483646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-28069e63-087b-4770-91ec-db0a44fb9335 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.165369 Nov 24 18:15:37.484265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 724/1449] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Nov 24 18:15:37 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:39.277941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:39.278822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:39.286751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:39.287198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:39.288033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:39.288469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:39.346099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-7920ac17-4773-4ddb-b68d-8141a47528d2 req-88d35cbd-9e43-40ff-81c5-7aae8cc16355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc1dcde-4d03-4fde-b034-be9d70cd2aa4", "tag": "3cb4783c-6d29-4fbc-af98-6c3ee3207737"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:39.347866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:15:39.347866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:15:39.356972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7920ac17-4773-4ddb-b68d-8141a47528d2 req-88d35cbd-9e43-40ff-81c5-7aae8cc16355 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:39.357440 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7920ac17-4773-4ddb-b68d-8141a47528d2 req-88d35cbd-9e43-40ff-81c5-7aae8cc16355 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:39.373860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-7920ac17-4773-4ddb-b68d-8141a47528d2 req-88d35cbd-9e43-40ff-81c5-7aae8cc16355 service nova] Creating event network-changed:3cb4783c-6d29-4fbc-af98-6c3ee3207737 for instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 on hv-cinder-81857 Nov 24 18:15:39.378971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-7920ac17-4773-4ddb-b68d-8141a47528d2 req-88d35cbd-9e43-40ff-81c5-7aae8cc16355 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103892 Nov 24 18:15:39.379588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 725/1450] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:39.392980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b535ae27-bc8a-4ea3-b0de-1fafdd79ab6b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.119905 Nov 24 18:15:39.394228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 726/1451] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:39 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:40.405635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:40.406848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:40.415414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:40.415913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:40.417514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:40.417856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:40.518028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2ba18b04-05a8-4c09-9ebe-cf6d043d67c7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.116313 Nov 24 18:15:40.518702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 726/1452] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:40 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:41.530436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:41.531480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:41.540695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:41.541141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:41.542862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:41.543312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:41.650532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d05d8ed-6cad-4156-9e3c-c4ed82589ddc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.124699 Nov 24 18:15:41.656100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 727/1453] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:41 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:42.665468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:42.666453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:42.675476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:42.675937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:42.676706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:42.677129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:42.779083 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a290f35b-4402-4ccb-b437-138c5ea65bb7 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.118067 Nov 24 18:15:42.779903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 727/1454] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:42 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:43.790519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:43.791535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:43.800569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:43.801117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:43.802104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:43.802534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:43.918068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e0a8d834-b1b8-43a9-9b72-5b9d94c1bf90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.131100 Nov 24 18:15:43.918761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 728/1455] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:43 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:44.929623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:44.930632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:44.940796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:44.941244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:44.942035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:44.942471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:45.041764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dc139aed-9957-4bce-ad64-0878bf0be47a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.116056 Nov 24 18:15:45.042884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 728/1456] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:44 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:46.054309 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:46.055288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:46.064516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:46.064895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:46.065655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:46.066093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:46.166227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e0e283ed-2d15-49e4-9fae-bbdd3b61714f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.115759 Nov 24 18:15:46.166840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 729/1457] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:46 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:47.177792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:47.178893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:47.188278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:47.188711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:47.189482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:47.189915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:47.286536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fd182e2c-a74d-49fa-8584-c25877154df6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 14 microversion: 2.1 time: 0.112816 Nov 24 18:15:47.287171 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 729/1458] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:47 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 18:15:48.298025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:48.300247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:48.308030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:48.308465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:48.309250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:48.310270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:48.428633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-84a0b699-38bf-4f64-945a-b1899424e291 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 945 microversion: 2.1 time: 0.134937 Nov 24 18:15:48.431793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 730/1459] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:48 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 945 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:15:49.420844 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:15:49.421695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:15:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:15:49.445019 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:49.446022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:49.454831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:49.455306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:49.456224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:49.456654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:49.567178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8afa7c9f-ccd9-44f6-89b4-e160109f5661 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 13651 microversion: 2.1 time: 0.129533 Nov 24 18:15:49.567905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 730/1460] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:49 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 13651 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:50.579710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:50.580625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:50.588649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:50.589093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:50.589870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:50.590301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:50.701374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a983d80d-740b-4ee5-99ef-399438cd70dd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 18356 microversion: 2.1 time: 0.125618 Nov 24 18:15:50.702018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 731/1461] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:50 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 18356 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:51.714324 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:51.715224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:51.724716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:51.725156 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:51.725923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:51.726348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:51.839192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d4959f3d-d0c5-41bb-9108-6130dee85839 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 19342 microversion: 2.1 time: 0.129108 Nov 24 18:15:51.839882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 731/1462] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:51 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 19342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:15:52.852321 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:52.853299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:52.862333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:52.862764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:52.863535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:52.864060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:52.971000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-649e75e6-4a50-4545-a503-5c96baca596a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 22070 microversion: 2.1 time: 0.122529 Nov 24 18:15:52.971779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 732/1463] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:52 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 22070 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:53.983586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:53.984599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:53.992484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:53.992924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:53.994017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:53.994158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:54.120001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8d78b20f-859b-46f0-ae2d-b8bd2f9ae122 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 23235 microversion: 2.1 time: 0.140910 Nov 24 18:15:54.120818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 732/1464] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:53 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 23235 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:55.132303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:55.133305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:55.142271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:55.142710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:55.143483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:55.143944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:55.255863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-47346cec-e6c8-4f40-b291-661b0f8e7e0f tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 24820 microversion: 2.1 time: 0.127416 Nov 24 18:15:55.256279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 733/1465] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:55 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 24820 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:56.268213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:56.269199 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:56.277106 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:56.277546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:56.278331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:56.279248 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:56.392862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b73d62f8-8ad4-4823-bb01-8bbf83452465 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 26407 microversion: 2.1 time: 0.128845 Nov 24 18:15:56.393514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 733/1466] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:56 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 26407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:15:57.405723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:57.406652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:57.415261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:57.415745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:57.416527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:57.417306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:57.544961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-384caa0b-87c6-4086-967f-6021b8a838b6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 27542 microversion: 2.1 time: 0.143344 Nov 24 18:15:57.545806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 734/1467] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:57 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 27542 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:58.557742 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:58.558794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:58.567970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:58.568664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:58.569873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:58.570555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:58.695312 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0afe5140-8500-4700-9557-46a0f18f00ec tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 27967 microversion: 2.1 time: 0.141332 Nov 24 18:15:58.695909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 734/1468] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:58 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 27967 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:15:59.707781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:15:59.708692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:15:59.718009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:59.718461 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:59.719235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:15:59.719703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:15:59.840096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-92722742-d96a-4916-9034-1b18b7877fcc tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28203 microversion: 2.1 time: 0.136283 Nov 24 18:15:59.840752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 735/1469] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:15:59 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28203 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:00.853422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:00.854435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:00.863099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:00.863540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:00.864389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:00.864815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:00.964306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7621fa88-5823-4922-be1e-13c5bf33f248 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28203 microversion: 2.1 time: 0.114601 Nov 24 18:16:00.965097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 735/1470] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:00 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28203 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:01.976610 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:01.977593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:01.986158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:01.986539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:01.987302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:01.987755 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:02.105424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e89a6600-bf9e-427b-a07a-adc1e45dac1a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28494 microversion: 2.1 time: 0.132674 Nov 24 18:16:02.106069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 736/1471] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:01 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28494 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:03.118226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:03.119155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:03.127066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:03.127506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:03.128306 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:03.128735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:03.251014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bb6b23ce-8d90-4574-9310-d015209c13eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28662 microversion: 2.1 time: 0.136726 Nov 24 18:16:03.251683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 736/1472] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:03 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28662 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:04.351706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:04.352698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:04.361266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:04.361710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:04.362480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:04.362912 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:04.464207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a97d8dc8-cc20-41fb-bd5b-9cfc2e087483 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28662 microversion: 2.1 time: 0.204687 Nov 24 18:16:04.464844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 737/1473] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:04 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:05.477382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:05.478263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:05.486959 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:05.487393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:05.488200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:05.488639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:05.594532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4e799497-26df-4908-8b41-3bcd69cd5b8c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28662 microversion: 2.1 time: 0.121277 Nov 24 18:16:05.595176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 737/1474] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:05 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28662 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:06.607290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:06.608316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:06.616210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:06.616658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:06.617427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:06.617886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:06.717539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-998e87f9-9d7c-434e-a1b0-1583d5b749c6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 28662 microversion: 2.1 time: 0.114326 Nov 24 18:16:06.718096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 738/1475] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:06 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 28662 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:07.729893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:07.730799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:07.738813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:07.739263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:07.740074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:07.740510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:07.854974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-54a5682c-8098-48f4-b4df-0cf96eaa6bcd tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 29188 microversion: 2.1 time: 0.129140 Nov 24 18:16:07.855633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 738/1476] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:07 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 29188 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:08.867927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:08.868918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:08.876858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:08.877302 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:08.878068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:08.878497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:08.996282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d29a070-af4d-45d7-a0f2-77ab22013980 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 31371 microversion: 2.1 time: 0.133230 Nov 24 18:16:08.996833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 739/1477] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:08 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 31371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:10.008651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:10.009659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:10.017946 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:10.018383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:10.019150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:10.019574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:10.129739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4741dbd1-5742-4555-b93d-12497afb9a90 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 33160 microversion: 2.1 time: 0.125023 Nov 24 18:16:10.130648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 739/1478] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:10 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 33160 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:11.142357 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:11.143340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:11.151473 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:11.151940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:11.152705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:11.153128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:11.267077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b8fed09a-2a34-4c35-ba65-1f9eecd16346 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 33934 microversion: 2.1 time: 0.129527 Nov 24 18:16:11.267758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 740/1479] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:11 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 33934 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:12.280379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:12.281375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:12.289633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:12.290075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:12.290856 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:12.291505 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:12.402210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ecf0a7f5-faff-464f-90a6-9f28a22b9d63 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 35094 microversion: 2.1 time: 0.126460 Nov 24 18:16:12.402770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 740/1480] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:12 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 35094 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:13.415194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:13.416252 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:13.426041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:13.426538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:13.427242 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:13.427689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:13.543216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2d125c12-9575-4c74-93be-8b2c51a56614 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 36534 microversion: 2.1 time: 0.131188 Nov 24 18:16:13.543216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 741/1481] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:13 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 36534 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:14.555239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:14.556295 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:14.565131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:14.565578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:14.566350 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:14.566789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:14.678194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-446a4b35-23bf-4988-b1ae-bf87adc2dcf1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 38076 microversion: 2.1 time: 0.126875 Nov 24 18:16:14.682494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 741/1482] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:14 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 38076 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:15.690787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:15.691807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:15.699577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:15.700618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:15.701378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:15.701807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:15.817793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aa249abb-ea6f-4032-a1c0-bf6975f96a7d tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 38184 microversion: 2.1 time: 0.130883 Nov 24 18:16:15.819104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 742/1483] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:15 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 38184 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:16.830913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:16.831928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:16.839916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:16.840429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:16.841760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:16.842167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:16.958625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3f966816-a9ff-4207-9e03-074eacd616f6 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 38184 microversion: 2.1 time: 0.131520 Nov 24 18:16:16.959186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 742/1484] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:16 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 38184 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:17.971203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:17.972230 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:17.980454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:17.980922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:17.981705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:17.982258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:18.095915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a5f9704-38e7-4274-b6dc-ccfa67b200ac tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 38184 microversion: 2.1 time: 0.128759 Nov 24 18:16:18.096589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 743/1485] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:17 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 38184 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:16:19.109566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:16:19.110423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:19.118849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:19.119334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:19.120141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:19.120574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:19.250018 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f6c5ef3b-439c-40c4-85aa-d19a7f8949eb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action" status: 200 len: 38311 microversion: 2.1 time: 0.145216 Nov 24 18:16:19.250692 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 743/1486] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:16:19 2021] POST /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/action => generated 38311 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:16:19.261353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:16:19.261933 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:16:19.271956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:19.271956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:19.271956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:16:19.271956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:16:19.332097 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bca9c360-2590-439e-8540-68459d1b6895 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/ips" status: 200 len: 144 microversion: 2.1 time: 0.074810 Nov 24 18:16:19.332676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 744/1487] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Nov 24 18:16:19 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4/ips => generated 144 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:32.505340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:17:32.505991 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:17:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:17:51.201799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:51.202367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:17:51.210304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:51.210737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:51.211487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:51.211941 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:51.272462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:17:51.380860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4291c68f-8e8f-4bc8-9d32-6328ad559bbf tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "DELETE /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 204 len: 0 microversion: 2.1 time: 0.183595 Nov 24 18:17:51.384151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 744/1488] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:17:51 2021] DELETE /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:17:51.390438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:51.391020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:17:51.398794 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:51.399235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:51.400051 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:51.400480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:51.649677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:51.658532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-533ec231-e9b3-4b09-a12c-e7cf38f5f1f8 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1515 microversion: 2.1 time: 0.272939 Nov 24 18:17:51.659107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 745/1489] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:51 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1515 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:52.677292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:52.678200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:17:52.688103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:52.688932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:52.689794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:52.690303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:52.800136 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-2fea1dcb-fe92-4479-a6a5-2c9f6132f38c req-c2b71722-e485-4a9a-9d04-a69fd3808830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93283903-e620-4b25-9d9b-dd8df929bc16", "name": "network-vif-deleted", "tag": "04235aaf-5ac9-4467-b036-cb16111e1bd9"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:17:52.802118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:17:52.802118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:17:52.810796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-2fea1dcb-fe92-4479-a6a5-2c9f6132f38c req-c2b71722-e485-4a9a-9d04-a69fd3808830 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:52.811305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-2fea1dcb-fe92-4479-a6a5-2c9f6132f38c req-c2b71722-e485-4a9a-9d04-a69fd3808830 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:52.826864 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-2fea1dcb-fe92-4479-a6a5-2c9f6132f38c req-c2b71722-e485-4a9a-9d04-a69fd3808830 service nova] Creating event network-vif-deleted:04235aaf-5ac9-4467-b036-cb16111e1bd9 for instance 93283903-e620-4b25-9d9b-dd8df929bc16 on hv-cinder-81857 Nov 24 18:17:52.832212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-2fea1dcb-fe92-4479-a6a5-2c9f6132f38c req-c2b71722-e485-4a9a-9d04-a69fd3808830 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109931 Nov 24 18:17:52.833739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 746/1490] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:17:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:17:52.899193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81c70350ee4996b85c33ec8fedaa55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19932e34745a434a9e17ef9a5fa6aa49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:17:52.909153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-17d12b6e-fd86-49ee-8b6b-2eb3e4db5d0f tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 200 len: 1473 microversion: 2.1 time: 0.236003 Nov 24 18:17:52.909792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 745/1491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:52 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:17:53.926773 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:17:53.927457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] [instance: 93283903-e620-4b25-9d9b-dd8df929bc16] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:17:53.935728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:53.936166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:53.936913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:17:53.937339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:17:53.991704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] HTTP exception thrown: Instance 93283903-e620-4b25-9d9b-dd8df929bc16 could not be found. Nov 24 18:17:53.992284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] Returning 404 to user: Instance 93283903-e620-4b25-9d9b-dd8df929bc16 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:17:53.993082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7474d441-3a9f-4794-8da8-9ec8c55db488 tempest-AttachVolumeNegativeTest-254599285 tempest-AttachVolumeNegativeTest-254599285-project] 10.222.0.64 "GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16" status: 404 len: 111 microversion: 2.1 time: 0.070675 Nov 24 18:17:53.993606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 747/1492] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:17:53 2021] GET /compute/v2.1/servers/93283903-e620-4b25-9d9b-dd8df929bc16 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:18:14.469315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:18:14.470068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:18:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:19:05.534976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:05.535718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:05.544045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:05.544746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:05.545540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:05.545971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:05.609663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:19:05.727998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e824c157-dd0f-470b-9a61-72dbba2845b5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 204 len: 0 microversion: 2.1 time: 0.195924 Nov 24 18:19:05.728581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 746/1493] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:19:05 2021] DELETE /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:19:05.737791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:05.738394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:05.746905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:05.747782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:05.748559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:05.749035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:05.966317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:05.974777 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-090078a9-dd0e-4068-8a8b-a7f5aaa26f20 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1508 microversion: 2.1 time: 0.240851 Nov 24 18:19:05.975353 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 748/1494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:05 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:19:06.997402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:06.998095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:07.017561 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:07.018006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:07.018772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:07.019198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:07.351207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:07.362361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a4a0ed90-d6c5-4134-a272-32698b4a4284 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 200 len: 1466 microversion: 2.1 time: 0.371095 Nov 24 18:19:07.362934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 747/1495] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:06 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 1466 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:07.373344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-7c3fa103-5915-499e-acc4-8cb9eb000c67 req-a7a2a1ed-0cf9-4439-8246-673dac759564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fbcf33-86b7-4b2f-9a5d-9c87da78fc27", "name": "network-vif-deleted", "tag": "2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:19:07.374953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:19:07.374953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:19:07.385482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-7c3fa103-5915-499e-acc4-8cb9eb000c67 req-a7a2a1ed-0cf9-4439-8246-673dac759564 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:07.386584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-7c3fa103-5915-499e-acc4-8cb9eb000c67 req-a7a2a1ed-0cf9-4439-8246-673dac759564 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:07.404164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-7c3fa103-5915-499e-acc4-8cb9eb000c67 req-a7a2a1ed-0cf9-4439-8246-673dac759564 service nova] Creating event network-vif-deleted:2e08c6e2-2e40-4ef4-8a5d-a5d93d31c67d for instance 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 on hv-cinder-81857 Nov 24 18:19:07.410674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-7c3fa103-5915-499e-acc4-8cb9eb000c67 req-a7a2a1ed-0cf9-4439-8246-673dac759564 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Nov 24 18:19:07.412052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 749/1496] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:08.380288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:08.380896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:08.389711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.390158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.390927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.391360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.442088 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] HTTP exception thrown: Instance 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 could not be found. Nov 24 18:19:08.442693 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Returning 404 to user: Instance 91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:19:08.443515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0c87f4d9-021d-4993-aa57-f596f0f83271 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27" status: 404 len: 111 microversion: 2.1 time: 0.067018 Nov 24 18:19:08.444096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 748/1497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:08 2021] GET /compute/v2.1/servers/91fbcf33-86b7-4b2f-9a5d-9c87da78fc27 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:19:08.454318 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:08.454960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:08.465156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.465888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.467163 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.467771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.536152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:19:08.654692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-512b201b-04cd-45a4-a8b9-76358a7e4bb3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 204 len: 0 microversion: 2.1 time: 0.205826 Nov 24 18:19:08.655329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 750/1498] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:19:08 2021] DELETE /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:19:08.663723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:08.664338 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:08.671776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.672224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.672985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:08.673422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:08.898025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:08.911632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ca6b540-2935-43ce-b905-71279c28be04 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1568 microversion: 2.1 time: 0.251989 Nov 24 18:19:08.912184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 749/1499] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:09.445497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:19:09.446046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:19:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:19:09.930239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:09.930920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:09.938480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:09.938925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:09.939718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:09.940141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:10.072272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:10.084165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fbc88f1d-5e58-4031-81c3-4c4ead5e671f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1526 microversion: 2.1 time: 0.157854 Nov 24 18:19:10.085950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 751/1500] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:10.145764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-7eb6797f-8dd4-458a-bb8f-24bb44026f81 req-222530e1-c2de-487a-b603-d7469a55406a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d195ce54-bd42-4deb-b7de-c80fcfcd3437", "name": "network-vif-deleted", "tag": "8b9bafad-9e4a-4de0-a61c-31c30b5ff84b"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:19:10.148099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:19:10.148099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:19:10.159045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7eb6797f-8dd4-458a-bb8f-24bb44026f81 req-222530e1-c2de-487a-b603-d7469a55406a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:10.159826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7eb6797f-8dd4-458a-bb8f-24bb44026f81 req-222530e1-c2de-487a-b603-d7469a55406a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:10.180187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-7eb6797f-8dd4-458a-bb8f-24bb44026f81 req-222530e1-c2de-487a-b603-d7469a55406a service nova] Creating event network-vif-deleted:8b9bafad-9e4a-4de0-a61c-31c30b5ff84b for instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 on hv-cinder-81857 Nov 24 18:19:10.185948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-7eb6797f-8dd4-458a-bb8f-24bb44026f81 req-222530e1-c2de-487a-b603-d7469a55406a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043904 Nov 24 18:19:10.186842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 750/1501] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:19:11.104014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:11.105128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:11.113113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:11.113558 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:11.114312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:11.114731 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:11.230549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:11.239413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-68e926f2-c455-4aba-ae2f-e5a3c7525d4b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139686 Nov 24 18:19:11.240002 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 752/1502] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:12.257590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:12.258280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:12.266381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:12.266825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:12.267588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:12.268043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:12.403723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:12.414246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-93adc8b7-1d49-43f4-974d-bed7bbd3ad27 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.160703 Nov 24 18:19:12.414978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 751/1503] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:13.434268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:13.435338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:13.460683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:13.461444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:13.462727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:13.463461 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:13.609521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:13.620609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-98d8b343-42f4-4e1a-b25f-893c1a019776 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.192159 Nov 24 18:19:13.621167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 753/1504] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:14.640919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:14.641517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:14.648908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:14.649357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:14.650135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:14.650572 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:14.772243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:14.781699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7efa5224-bfe7-450e-ba1f-51c52b878ba6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.144624 Nov 24 18:19:14.782270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 752/1505] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:15.798625 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:15.799708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:15.807414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:15.808090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:15.808850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:15.809859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:15.927964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:15.937492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-df0ebdb5-16d4-4792-bee3-34303732cdb7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.142384 Nov 24 18:19:15.938053 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 754/1506] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:15 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:16.954687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:16.955411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:16.963261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:16.963831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:16.964595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:16.965031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:17.139153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:17.147857 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-83e124c0-b7df-4d61-8533-6f959e24a641 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.197061 Nov 24 18:19:17.148409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 753/1507] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:18.164465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:18.165076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:18.172624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:18.173060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:18.173890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:18.174622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:18.287177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:18.296451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3ba08344-45ab-46d3-a2bb-8baa569a2d77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135718 Nov 24 18:19:18.297020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 755/1508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:19.313602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:19.314161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:19.321474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:19.321921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:19.322686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:19.323122 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:19.438065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:19.446880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-23711862-d82f-487e-9b94-0ed9b466e4a4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137712 Nov 24 18:19:19.447434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 754/1509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:20.464161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:20.464751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:20.472649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:20.473083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:20.473839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:20.474264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:20.589030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:20.597892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d8eaba91-3fc2-4858-9dd9-f13ec569d84b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137390 Nov 24 18:19:20.598462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 756/1510] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:21.615014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:21.615576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:21.623131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:21.623575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:21.624367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:21.624799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:21.741091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:21.750510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-16eee2be-4d41-442d-87a3-cc0e2535433a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139250 Nov 24 18:19:21.751062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 755/1511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:22.767547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:22.768189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:22.775496 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:22.776336 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:22.776959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:22.777997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:23.036367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:23.044885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5e350be7-5515-404f-b056-9c4fa6e7fb77 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.281198 Nov 24 18:19:23.045430 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 757/1512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:22 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:24.062599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:24.063217 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:24.070751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:24.071190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:24.071986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:24.072414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:24.188956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:24.197503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c4c2a62d-8fca-4b3a-b4ea-eb3afecd5a6f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139298 Nov 24 18:19:24.198048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 756/1513] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:25.215940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:25.216762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:25.224137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:25.224571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:25.225329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:25.225833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:25.341188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:25.350300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-913f10d2-c52b-43d2-acd3-427f0a2d6c29 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138794 Nov 24 18:19:25.350913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 758/1514] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:26.366566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:26.367197 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:26.375458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:26.375932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:26.376709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:26.377148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:26.500708 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:26.509597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a88082e9-1d13-4ca6-8b2f-372ad1ef1857 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.146665 Nov 24 18:19:26.510173 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 757/1515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:27.526348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:27.526960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:27.534225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:27.534743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:27.535507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:27.536000 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:27.651787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:27.660765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7f0d496f-1700-43eb-9694-236a6fe20e8f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138103 Nov 24 18:19:27.661317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 759/1516] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:28.680331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:28.680938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:28.689465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:28.689908 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:28.690681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:28.691117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:28.815016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:28.826379 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7882ca09-91a9-4895-af74-0717bdd05ce9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.151021 Nov 24 18:19:28.826982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 758/1517] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:29.844409 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:29.845068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:29.853110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:29.853541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:29.854314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:29.854733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:29.979663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:29.989499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-31aed245-44b2-4ffc-bdb0-1e8aed4756f5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.149650 Nov 24 18:19:29.990047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 760/1518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:31.007435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:31.008126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:31.016837 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:31.017276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:31.018057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:31.018489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:31.131087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:31.140793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-131d2083-fea3-4e73-9d7f-00ab50697df5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136989 Nov 24 18:19:31.141357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 759/1519] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:32.161989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:32.162601 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:32.170489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:32.170921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:32.171712 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:32.172140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:32.283436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:32.291959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a8318529-ce1d-4b75-8e29-ab4e51ff9709 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.133598 Nov 24 18:19:32.292511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 761/1520] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:33.310016 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:33.310828 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:33.317890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:33.318336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:33.319098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:33.319531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:33.443762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:33.452647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-49f6ba16-7abd-48c8-bc6f-485c9425799a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.146895 Nov 24 18:19:33.453204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 760/1521] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:34.468529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:34.469131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:34.476288 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:34.476729 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:34.477477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:34.477904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:34.592644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:34.601188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b033a570-56b1-41a0-bef2-66db6053886c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136487 Nov 24 18:19:34.601741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 762/1522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:35.618365 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:35.618984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:35.626576 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:35.627021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:35.627820 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:35.628252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:35.742226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:35.751266 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-358b6e78-996a-4d4a-a7c8-4acc10d8dbb6 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136657 Nov 24 18:19:35.751851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 761/1523] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:36.768347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:36.768960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:36.776151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:36.776590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:36.777339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:36.778268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:36.892617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:36.901064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-06910ee7-da87-40e7-b5dd-af11f0e9f6b9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136412 Nov 24 18:19:36.901606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 763/1524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:37.918957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:37.919651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:37.926996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:37.927435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:37.928227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:37.928667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:38.046776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:38.056770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90d6c558-c6ff-4f66-b3eb-e5e11cf67636 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.141907 Nov 24 18:19:38.057532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 762/1525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:37 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:39.074048 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:39.075131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:39.082395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:39.082858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:39.083630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:39.084052 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:39.195608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:39.205811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7e6afee3-dc67-45d2-ba63-e313f29a784f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135491 Nov 24 18:19:39.206371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 764/1526] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:40.222567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:40.223155 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:40.230364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:40.230804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:40.232240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:40.232701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:40.348149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:40.357094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ba2f9f9f-a575-4dcf-b768-7d1eefc68ca4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138208 Nov 24 18:19:40.357654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 763/1527] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:41.376944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:41.377630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:41.386060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:41.386629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:41.387949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:41.388377 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:41.503670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:41.512741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-51b23718-2c9f-47cd-b274-69dbaec7b2b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.142122 Nov 24 18:19:41.513296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 765/1528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:42.530162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:42.530765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:42.538193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:42.538639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:42.539408 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:42.539863 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:42.658027 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:42.666636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b3322ee8-e4e0-4be7-b020-878d867c7dbb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140687 Nov 24 18:19:42.667668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 764/1529] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:43.685314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:43.685944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:43.693113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:43.693497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:43.694254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:43.694681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:43.812352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:43.820818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c8f0c601-49e5-4982-a964-75f1f9400feb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139859 Nov 24 18:19:43.821371 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 766/1530] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:44.838559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:44.839190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:44.846580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:44.847017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:44.847814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:44.848238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:44.973555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:44.982650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fb6e5b62-86ae-44ee-ab92-834ef6e57c5a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.148276 Nov 24 18:19:44.991710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 765/1531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:44 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:45.999682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:46.000283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:46.008225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:46.008671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:46.009466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:46.010007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:46.123647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:46.132176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e0b60e84-4971-4e78-9ab1-ed4c95cbc2ce tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136820 Nov 24 18:19:46.132669 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 767/1532] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:47.148683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:47.149291 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:47.157133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:47.157574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:47.158326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:47.158852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:47.277923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:47.286531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f1867cf7-77fc-4ffa-96a9-e68a7b98bfc7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.141456 Nov 24 18:19:47.287095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 766/1533] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:48.303772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:48.304397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:48.311629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:48.312063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:48.312817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:48.313248 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:48.427535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:48.437531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e431d6c5-ce11-4721-a016-aa0e085c4100 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137372 Nov 24 18:19:48.438091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 768/1534] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:49.454997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:49.456103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:49.465747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:49.466190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:49.466982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:49.467413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:49.599544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:49.609797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ae8085f0-c56e-4c50-974d-db966e32fe88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.158876 Nov 24 18:19:49.610390 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 767/1535] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:50.635516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:50.636549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:50.645963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:50.646400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:50.647161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:50.647583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:50.766645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:50.775523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f1d3ba34-f826-4f6a-811c-f6315c4eba93 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.145114 Nov 24 18:19:50.776261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 769/1536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:51.793497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:51.794103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:51.802582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:51.803024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:51.810506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:51.810506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:51.919065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:51.929301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-791d9d69-b9e1-475c-abc2-6d31a64b472d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139483 Nov 24 18:19:51.929865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 768/1537] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:52.946195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:52.946801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:52.956816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:52.957497 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:52.958758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:52.959528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:53.102193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:53.111205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e1b81377-caa2-475a-8593-d24154c6c66d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.168691 Nov 24 18:19:53.111826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 770/1538] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:52 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:54.128274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:54.128875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:54.136348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:54.136792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:54.137581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:54.138610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:54.254004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:54.262540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d65e060f-afd6-4b20-9196-6dbeea0a9f0b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137867 Nov 24 18:19:54.263924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 769/1539] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:55.281106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:55.281767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:55.291840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:55.292280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:55.293045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:55.293778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:55.410998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:55.419843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-43b6211d-0fb1-44d7-b2a0-00b67a95b03e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.143100 Nov 24 18:19:55.420508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 771/1540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:56.438374 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:56.438985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:56.446814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:56.447267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:56.448086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:56.448527 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:56.565952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:56.574767 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90a7e7e5-0b80-453a-8277-3df0307a4a3c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140759 Nov 24 18:19:56.575332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 770/1541] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:57.592361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:57.592947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:57.601793 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:57.602570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:57.603359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:57.603837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:57.722057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:57.730552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-083f264b-e13f-4a92-8dc6-84b5570788e9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.142747 Nov 24 18:19:57.731105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 772/1542] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:58.748287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:58.748860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:58.756597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:58.757036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:58.757796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:58.758226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:58.872258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:19:58.881723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e0e52b1a-001f-47bb-94ad-fbd4c9e0db09 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137267 Nov 24 18:19:58.882284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 771/1543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:19:59.898280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:19:59.898865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:19:59.905884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:59.906317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:19:59.907065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:19:59.908070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:00.022842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:00.031412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-87a7aab7-3f7f-45dc-8b09-fbfb373785b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136850 Nov 24 18:20:00.031988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 773/1544] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:19:59 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:01.048616 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:01.049453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:01.056425 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:01.056871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:01.057635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:01.058065 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:01.171257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:01.180625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-131ca187-2b36-4f8a-9891-e3213c90da1c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135956 Nov 24 18:20:01.181174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 772/1545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:02.197955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:02.198629 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:02.206083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:02.206523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:02.207344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:02.207828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:02.322462 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:02.331151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e6322c8-aab3-4c36-8a0b-363b3bc94397 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136836 Nov 24 18:20:02.331806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 774/1546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:03.352154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:03.352758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:03.360069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:03.360575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:03.361341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:03.361776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:03.476271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:03.484921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2c48334c-4988-40b3-9c2f-4044c2704e70 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136470 Nov 24 18:20:03.485675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 773/1547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:04.504627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:04.505232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:04.512448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:04.512891 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:04.513649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:04.514081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:04.628138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:04.636603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-61b300c6-b874-4bdd-a4e9-6d764657b2ad tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135730 Nov 24 18:20:04.637153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 775/1548] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:05.653676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:05.654283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:05.662345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:05.662789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:05.663551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:05.664033 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:05.778592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:05.787814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-77dd9eb4-f602-4388-8064-0da730619656 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137803 Nov 24 18:20:05.788366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 774/1549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:05 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:06.805267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:06.805869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:06.814849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:06.815107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:06.816013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:06.816494 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:06.929543 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:06.937924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f20ad35f-cb8a-4b09-a624-d6ddcb52c9a1 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136449 Nov 24 18:20:06.938480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 776/1550] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:20:07.955953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:07.956561 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:07.963747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:07.964198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:07.964957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:07.965385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:08.078192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:08.087873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a47cf93c-3bb4-49fc-8819-1df3551315fb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136427 Nov 24 18:20:08.088430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 775/1551] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:09.105105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:09.105696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:09.113869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:09.114333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:09.115108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:09.115537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:09.232738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:09.243164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9152459c-38a3-41a7-a7a0-428f545996cf tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.141768 Nov 24 18:20:09.243771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 777/1552] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:10.260965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:10.261550 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:10.269211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:10.269662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:10.270432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:10.270876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:10.383923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:10.393853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cec3e996-c65f-42fd-911d-70c6473d890e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135812 Nov 24 18:20:10.395337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 776/1553] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:11.410735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:11.411343 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:11.418870 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:11.419310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:11.420120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:11.420554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:11.540416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:11.550865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-67ea1873-aaaf-4253-8f55-914f8f5b43f9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.143367 Nov 24 18:20:11.551406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 778/1554] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:20:12.568603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:12.569249 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:12.576529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:12.576976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:12.577749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:12.578184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:12.694008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:12.702669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f42986be-6518-43b1-8fae-00ecf3491cf9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138241 Nov 24 18:20:12.703220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 777/1555] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:12 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:13.720243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:13.720815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:13.728468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:13.728913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:13.729673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:13.730101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:13.845216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:13.854561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-90f90cd1-7a17-4224-8aff-07d4ff83eaff tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138294 Nov 24 18:20:13.855129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 779/1556] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:13 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:20:14.872077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:14.872715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:14.881860 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:14.882668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:14.883979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:14.884808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:15.009488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:15.018546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-edffc0b2-02f3-468c-9dcd-57a57dc8f4df tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.150082 Nov 24 18:20:15.020028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 778/1557] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:14 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:16.035799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:16.036416 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:16.043966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:16.044413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:16.045211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:16.045645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:16.164099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:16.174043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-330da5fe-7e6e-49a1-a5d5-0f1d8e29253b tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.141879 Nov 24 18:20:16.174934 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 780/1558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:16 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:17.194487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:17.195684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:17.205399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:17.205834 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:17.207242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:17.209167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:17.337980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:17.351213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-51064c8d-894d-42bc-bb9b-e44ebe0ba9f7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.160685 Nov 24 18:20:17.352022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 779/1559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:17 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:18.371271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:18.372056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:18.379862 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:18.380330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:18.381110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:18.381538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:18.538389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:18.547124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7bf8c06e-2cf2-4cfa-9025-4d92e52cc2e4 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.179357 Nov 24 18:20:18.547761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 781/1560] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:18 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:19.569898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:19.570544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:19.577975 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:19.578446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:19.579240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:19.579716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:19.701864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:19.710893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0634a703-3b2b-4e7f-8a52-94b16e1e5c2a tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.146755 Nov 24 18:20:19.711542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 780/1561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:19 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:20.728150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:20.728754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:20.736956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:20.737258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:20.739421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:20.739950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:20.857113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:20.867798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6da251fd-7e44-4bdb-93b0-9d10087dc428 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.143336 Nov 24 18:20:20.868365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 782/1562] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:20 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:21.885411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:21.886029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:21.893596 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:21.894029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:21.895509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:21.896237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:22.062221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:22.073680 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6bbdd74a-7171-402f-a549-134fbe580dcc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.192133 Nov 24 18:20:22.074391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 781/1563] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:21 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:20:23.091331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:23.092090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:23.100562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:23.101008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:23.101785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:23.102368 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:23.217875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:23.227956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e670525e-21d4-4b3d-b2fc-9d7140167c0e tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140221 Nov 24 18:20:23.228633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 783/1564] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:23 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:24.244853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:24.245468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:24.254267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:24.255074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:24.256953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:24.257741 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:24.374578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:24.383995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-36760027-da32-43c7-80a4-a069a74fcc16 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.142732 Nov 24 18:20:24.384637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 782/1565] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:24 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:25.400531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:25.401771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:25.409768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:25.410210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:25.410966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:25.411952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:25.526512 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:25.535322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6572015b-af01-4bce-8542-9780da5111d8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138236 Nov 24 18:20:25.536026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 784/1566] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:25 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:26.553732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:26.554405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:26.561606 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:26.562054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:26.562818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:26.563250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:26.677840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:26.686866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7db69cc8-8cca-43ba-b221-955e28e057d2 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137470 Nov 24 18:20:26.687434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 783/1567] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:26 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:27.704925 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:27.705527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:27.713487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:27.713930 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:27.714695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:27.715126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:27.826599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:27.836406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-03c72b13-4f79-4008-bec1-955985a783bc tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135163 Nov 24 18:20:27.836971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 785/1568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:27 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:28.853755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:28.854360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:28.861761 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:28.862206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:28.862970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:28.863403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:28.977586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:28.986040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9bc2d655-00e6-445c-9f84-e70fc4660525 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136559 Nov 24 18:20:28.986599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 784/1569] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:28 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:30.002064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:30.002649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:30.010698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:30.011133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:30.011916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:30.012338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:30.129495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:30.139129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-011309c1-378c-4e95-99dd-2618eedf984f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140814 Nov 24 18:20:30.139693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 786/1570] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:29 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:31.156902 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:31.157507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:31.165573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:31.166017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:31.166778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:31.167213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:31.278331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:31.287919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1db65964-4b64-42eb-95f9-28ac70faa653 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.134043 Nov 24 18:20:31.288487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 785/1571] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:31 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:32.305564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:32.306149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:32.313314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:32.313751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:32.314515 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:32.314942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:32.429240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:32.438139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a9f2750a-71f6-4488-9266-7a484ce0cad0 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136992 Nov 24 18:20:32.438906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 787/1572] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:32 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:33.455140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:33.455781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:33.463393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:33.463880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:33.464644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:33.465078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:33.581766 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:33.590549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3bb168fd-6e25-47f4-927e-c0cfd26a8a9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139037 Nov 24 18:20:33.591138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 786/1573] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:33 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:34.607928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:34.608466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:34.615976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:34.616420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:34.617184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:34.617618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:34.729330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:34.738056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fbbd5b31-3c14-4582-9b46-f14c5a57608f tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.133933 Nov 24 18:20:34.738617 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 788/1574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:34 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:35.755193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:35.756284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:35.763042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:35.763486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:35.764283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:35.764716 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:35.879341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:35.888978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-dde44cb2-01cf-461a-8066-dff6f2ee8b18 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137524 Nov 24 18:20:35.889575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 787/1575] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:35 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:36.905524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:36.906131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:36.914118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:36.914562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:36.915327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:36.915802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:37.030378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:37.039541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c7c37f45-f0e0-40d5-b743-53c636bb8914 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137700 Nov 24 18:20:37.040128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 789/1576] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:36 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:38.056705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:38.057321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:38.064539 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:38.064991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:38.065753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:38.066189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:38.178361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:38.186879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-17b7a932-ee3e-41fa-a5c9-484d9cd4fca5 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.134690 Nov 24 18:20:38.187433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 788/1577] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:38 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:39.203485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:39.204265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:39.211788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:39.212229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:39.212973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:39.213392 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:39.412327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:39.422276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2ec8333e-03f5-4e9e-8a88-172f53056b17 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.222357 Nov 24 18:20:39.423131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 790/1578] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:39 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:40.440367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:40.440977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:40.449995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:40.450446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:40.451225 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:40.451683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:40.573883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:40.582614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-511dd4b6-8194-4ba3-b7a3-17feb654d2ac tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.145944 Nov 24 18:20:40.583189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 789/1579] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:40 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:41.601485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:41.602066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:41.609092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:41.609528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:41.610281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:41.610702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:41.721593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:41.731303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d1956946-183d-46a8-bdcf-aef2f9cf1a91 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.134635 Nov 24 18:20:41.731907 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 791/1580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:41 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:42.748066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:42.748647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:42.755923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:42.756377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:42.757149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:42.757566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:42.873134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:42.881905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1ddb9801-0960-4cab-a53c-d59120f5831d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137556 Nov 24 18:20:42.882462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 790/1581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:42 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:43.899817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:43.900470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:43.907770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:43.908216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:43.908990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:43.909425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:44.027771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:44.036264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f2f2af21-ff33-46f5-8c49-3dbaaa6e7543 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140999 Nov 24 18:20:44.037488 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 792/1582] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:43 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:45.053442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:45.054040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:45.061499 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:45.061983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:45.062781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:45.063215 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:45.176252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:45.186170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ed171485-1295-4878-a8f4-30d0d8d650a9 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137092 Nov 24 18:20:45.186730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 791/1583] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:45 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:46.203636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:46.204242 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:46.212223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:46.212659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:46.213413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:46.213835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:46.326144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:46.335549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e30c258-8809-49b5-b4fb-5b2825b05d66 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135763 Nov 24 18:20:46.336211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 793/1584] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:46 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:47.352736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:47.353415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:47.360490 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:47.360937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:47.361696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:47.362126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:47.480477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:47.489280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-52f3b005-783a-4c48-a2f7-c503da98099d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140754 Nov 24 18:20:47.490151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 792/1585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:47 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:48.506684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:48.507300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:48.514593 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:48.515043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:48.515851 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:48.516286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:48.631875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:48.640790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9fe340cc-e2ee-4306-8f4e-7c81a8676704 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138316 Nov 24 18:20:48.641358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 794/1586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:48 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:49.658336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:49.658935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:49.666311 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:49.666749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:49.667528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:49.667983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:49.784196 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:49.792821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fdbe3914-61be-4ae4-933c-a1fa9f665f48 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138271 Nov 24 18:20:49.793396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 793/1587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:49 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:50.808167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:20:50.811436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:50.812068 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:50.819989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:50.820432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:50.821284 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:50.821619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:50.938643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:50.950856 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d5c1de8-d385-4d6d-9910-d350664739b8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.143790 Nov 24 18:20:50.951564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 795/1588] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:50 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:51.968159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:51.968752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:51.977165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:51.977610 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:51.978373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:51.978804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:52.094256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:52.104794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d96eaef5-a8f4-4ba4-8903-4f24b4430907 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140305 Nov 24 18:20:52.105506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 794/1589] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:51 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:52.525124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:20:52.525690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:20:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:20:53.124956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:53.125618 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:53.144331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:53.144780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:53.145553 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:53.145980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:53.180725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 36160. Nov 24 18:20:53.261663 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:53.271310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-03976623-d8eb-46ff-a0ac-a5e90f0baff3 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.152452 Nov 24 18:20:53.279732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 796/1590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:53 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:54.288789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:54.289385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:54.296624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:54.297072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:54.297841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:54.298272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:54.418656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:54.430706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c4b70ca9-1f5e-4247-af33-281acc77daeb tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.146197 Nov 24 18:20:54.431281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 795/1591] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:54 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:55.448460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:55.449149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:55.456261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:55.456710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:55.457470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:55.457903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:55.573670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:55.582407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0acd4b39-bf65-41e2-be2e-1855788038e8 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139030 Nov 24 18:20:55.582976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 797/1592] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:55 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:56.598400 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:56.599003 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:56.606813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:56.607258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:56.608052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:56.608487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:56.724709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:56.733815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c761938c-8085-481c-a2dd-e8b4ace121b7 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139002 Nov 24 18:20:56.734383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 796/1593] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:56 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:57.749770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:57.750457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:57.758337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:57.758847 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:57.759594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:57.760112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:57.879276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:57.889390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd5c118c-819f-4548-b907-56c744a8a28d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.143203 Nov 24 18:20:57.889945 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 798/1594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:57 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:20:58.907140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:20:58.907780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:20:58.915756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:58.916186 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:58.916956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:20:58.917389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:20:59.029461 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:20:59.039214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9509dfce-9894-4df0-b23d-2112ea3f4269 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135791 Nov 24 18:20:59.039801 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 797/1595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:20:58 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:00.056542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:00.057144 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:00.064479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:00.064915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:00.065673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:00.066098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:00.177520 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:00.186401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6b301409-016f-404a-aa78-3da56bbf4509 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.134144 Nov 24 18:21:00.186955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 799/1596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:00 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:01.203137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:01.203770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:01.211231 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:01.211705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:01.212462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:01.212894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:01.327103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:01.335944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-52ddd808-5853-4f25-9421-8941931a7f6c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.136433 Nov 24 18:21:01.336515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 798/1597] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:01 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:02.353151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:02.353964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:02.361156 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:02.361601 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:02.362369 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:02.362798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:02.478475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:02.487161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-eda9e22f-5839-43d3-a7f4-663478b1c267 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.138460 Nov 24 18:21:02.487936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 800/1598] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:02 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:02.526977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:21:02.527510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:21:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:21:03.715713 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:03.716493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:03.723976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:03.724909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:03.725700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:03.726128 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:03.848060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:03.857204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5e568188-6452-4843-a147-071f53052cca tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.356035 Nov 24 18:21:03.857789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 799/1599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:03 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:04.874916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:04.875521 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:04.883467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:04.883940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:04.884701 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:04.885133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:05.002802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:05.012126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-81834cde-91cc-4f44-86d3-336324439d9c tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.140687 Nov 24 18:21:05.012684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 801/1600] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:04 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:06.028957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:06.029573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:06.037691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:06.038144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:06.038916 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:06.039355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:06.154816 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:06.164403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-03d2310d-c8b0-4e97-a812-d1a9ca820a53 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.139117 Nov 24 18:21:06.164994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 800/1601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:06 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:07.181183 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:07.181789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:07.189032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:07.189477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:07.190245 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:07.190679 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:07.305845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:07.314500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4e3b65fa-c2e9-4249-ae20-64d2bfb9ee19 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.137040 Nov 24 18:21:07.315055 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 802/1602] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:07 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:08.331937 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:08.332543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:08.340258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:08.340702 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:08.341467 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:08.341900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:08.453888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:08.463358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-491812e8-b3d5-458b-8b23-68674e14622d tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.135074 Nov 24 18:21:08.463942 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 801/1603] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:08 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:09.480199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:09.480805 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:09.487992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:09.488438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:09.489196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:09.489627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:09.600323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:09.608709 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d2cf4870-0adb-44ca-9f20-406a90db4e88 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1353 microversion: 2.1 time: 0.132148 Nov 24 18:21:09.609260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 803/1604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:09 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:10.625736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:10.626344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:10.634445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:10.634898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:10.635674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:10.636110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:10.707839 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:10.708193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:10.708631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lazy-loading 'fault' on Instance uuid d195ce54-bd42-4deb-b7de-c80fcfcd3437 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:21:10.769659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb49727a87c45e29a57e7dcc0367c53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f9bbe7d66843e4bdc67eed822136d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:10.778290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-218f13bf-f9a6-40f0-b54a-d834977d6d31 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 200 len: 1447 microversion: 2.1 time: 0.156145 Nov 24 18:21:10.778862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 802/1605] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:10 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:11.796187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:11.796788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] [instance: d195ce54-bd42-4deb-b7de-c80fcfcd3437] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:11.805555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:11.805999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:11.806796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:11.807228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:11.858756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] HTTP exception thrown: Instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 could not be found. Nov 24 18:21:11.859337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] Returning 404 to user: Instance d195ce54-bd42-4deb-b7de-c80fcfcd3437 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:21:11.860171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b7bcaa57-376d-4fdf-9672-c8a0e6666661 tempest-ServerRescueNegativeTestJSON-1670989141 tempest-ServerRescueNegativeTestJSON-1670989141-project] 10.222.0.64 "GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437" status: 404 len: 111 microversion: 2.1 time: 0.067786 Nov 24 18:21:11.860714 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 804/1606] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:21:11 2021] GET /compute/v2.1/servers/d195ce54-bd42-4deb-b7de-c80fcfcd3437 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:21:24.002161 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: .version_select at 0x7f8b10ba0700>, body: {"keypair": {"name": "tempest-keypair-652726012"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:24.027710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:21:24.031939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:21:24.185725 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:21:24.190118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:21:24.204336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a2c53770-37e1-4c2d-ac00-876ce7d3d900 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.324551 Nov 24 18:21:24.204997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 803/1607] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Nov 24 18:21:23 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 326 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:21:26.080922 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-546598598", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ce9ad89-4e1b-4004-865a-96f49d2d4197"}], "security_groups": [{"name": "tempest-securitygroup--1559570960"}], "key_name": "tempest-keypair-652726012", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:26.222903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] validate_networks() for [('3ce9ad89-4e1b-4004-865a-96f49d2d4197', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:21:26.909836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:21:26.910350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:21:26.910921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:21:26.911411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:21:26.912009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:21:26.924602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:26.925199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:26.926339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:26.926781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:26.964848 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:21:26.972118 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:21:26.989715 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:21:26.993193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:21:27.067364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c1469278-92e6-4ad3-9854-745370500d9f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.991390 Nov 24 18:21:27.084159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:27.085489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:27.089303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 805/1608] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Nov 24 18:21:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 18:21:27.258409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.267690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.269818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:27.271172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-51d3da99-2132-46ed-88f7-397a08cab05b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1280 microversion: 2.20 time: 0.193067 Nov 24 18:21:27.272398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 804/1609] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:27 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:28.289967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:28.290548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:28.297826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:28.298267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:28.299021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:28.299739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:28.415660 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.425107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.427096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:28.428977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c9b42e15-0990-4e4a-9cea-e31d788a2838 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1332 microversion: 2.20 time: 0.142957 Nov 24 18:21:28.430089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 806/1610] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:28 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1332 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:29.448724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:29.449813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:29.460426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:29.460704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:29.461452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:29.461894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:29.920269 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.929626 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.931115 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:29.932218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8e54c73b-d0ef-4327-85a6-da9c46316f2d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.488132 Nov 24 18:21:29.932772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 805/1611] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:29 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:30.664738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-c520a3dd-e5a0-4688-8944-8436ec48bbef req-b02271a0-57d7-4a8b-84d4-63368f725423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:30.669276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:21:30.669276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:21:30.684723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-c520a3dd-e5a0-4688-8944-8436ec48bbef req-b02271a0-57d7-4a8b-84d4-63368f725423 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:30.685308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-c520a3dd-e5a0-4688-8944-8436ec48bbef req-b02271a0-57d7-4a8b-84d4-63368f725423 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:30.713578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-c520a3dd-e5a0-4688-8944-8436ec48bbef req-b02271a0-57d7-4a8b-84d4-63368f725423 service nova] Creating event network-changed:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:21:30.724509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-c520a3dd-e5a0-4688-8944-8436ec48bbef req-b02271a0-57d7-4a8b-84d4-63368f725423 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068783 Nov 24 18:21:30.726707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 807/1612] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:21:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:30.950874 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:30.952273 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:30.962361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:30.962954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:30.963864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:30.964532 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:31.286123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:31.295660 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:31.298090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:31.300469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-82122daa-2e49-4cc4-90aa-030f539ab361 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.353883 Nov 24 18:21:31.301028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 806/1613] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:30 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:32.320992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:32.321702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:32.328969 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:32.329402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:32.330201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:32.330628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:32.530749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.540443 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.541960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:32.543102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d7dce29f-a326-4f39-b43d-cf8af860f04f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.226833 Nov 24 18:21:32.543841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 808/1614] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:32 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:33.560847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:33.561453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:33.568743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:33.569190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:33.569958 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:33.570398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:33.766160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.780442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.781958 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:33.783021 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ab943656-aa2d-4106-a5da-93e67817c563 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.226190 Nov 24 18:21:33.783564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 807/1615] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:33 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:34.486492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:21:34.487013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:21:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:21:34.801585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:34.802256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:34.813820 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:34.814285 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:34.815074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:34.815516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:34.820780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-362b08e5-4098-46bd-bb52-81caaa7ab8a5 req-b32bd644-e299-4235-8783-23c5c4d6da62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "name": "network-vif-plugged", "status": "completed", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:34.822380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:21:34.822380 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:21:34.831331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-362b08e5-4098-46bd-bb52-81caaa7ab8a5 req-b32bd644-e299-4235-8783-23c5c4d6da62 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:34.832602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-362b08e5-4098-46bd-bb52-81caaa7ab8a5 req-b32bd644-e299-4235-8783-23c5c4d6da62 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:34.855678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-362b08e5-4098-46bd-bb52-81caaa7ab8a5 req-b32bd644-e299-4235-8783-23c5c4d6da62 service nova] Creating event network-vif-plugged:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:21:34.861128 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-362b08e5-4098-46bd-bb52-81caaa7ab8a5 req-b32bd644-e299-4235-8783-23c5c4d6da62 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116729 Nov 24 18:21:34.861708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 809/1616] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:21:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:21:35.022212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.031990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.033491 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:35.034525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bd4033af-29c1-490a-b74d-d742eb350593 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.236918 Nov 24 18:21:35.035069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 808/1617] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:34 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:21:36.052689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:36.053567 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:36.060799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:36.061241 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:36.061995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:36.062425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:36.255508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.265286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.267233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:36.268722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d02fdafa-c7cc-4d3f-af6c-97be50eb7832 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1406 microversion: 2.20 time: 0.220067 Nov 24 18:21:36.269268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 810/1618] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:36 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:37.286511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:37.286912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:37.294931 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:37.295372 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:37.296163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:37.296594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:37.498985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.507669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.509098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:21:37.510201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0069841d-b53a-40cd-9594-f8e799cef468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1597 microversion: 2.20 time: 0.227963 Nov 24 18:21:37.510746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 809/1619] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:21:37 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1597 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:37.528193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:21:37.528687 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:37.535723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:37.536221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:37.536968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:37.538305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:37.684686 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-049cc9b1-d68d-4fc8-a38b-10aaeb92577c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160102 Nov 24 18:21:37.685261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 811/1620] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 24 18:21:37 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:21:39.233678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:39.235303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:39.243952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:39.244500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:39.245357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:39.245996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:39.295040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-d6fa5bc0-8716-45cd-b4c4-3f1276c577c4 req-27b2a510-c7d0-4cd7-b16d-a4d3e20fbd6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:39.297272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:21:39.297272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:21:39.307429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-d6fa5bc0-8716-45cd-b4c4-3f1276c577c4 req-27b2a510-c7d0-4cd7-b16d-a4d3e20fbd6f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:39.307889 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-d6fa5bc0-8716-45cd-b4c4-3f1276c577c4 req-27b2a510-c7d0-4cd7-b16d-a4d3e20fbd6f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:39.325315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-d6fa5bc0-8716-45cd-b4c4-3f1276c577c4 req-27b2a510-c7d0-4cd7-b16d-a4d3e20fbd6f service nova] Creating event network-changed:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:21:39.330078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-d6fa5bc0-8716-45cd-b4c4-3f1276c577c4 req-27b2a510-c7d0-4cd7-b16d-a4d3e20fbd6f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097942 Nov 24 18:21:39.330655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 812/1621] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:21:39.353939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e1c73604-f708-494d-a892-55648029426c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.124081 Nov 24 18:21:39.354848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 810/1622] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:39 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:40.366060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:40.367165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:40.374879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:40.375278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:40.376101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:40.376547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:40.477452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-af6d6f84-e54b-4597-a9b4-68b374b94051 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.115577 Nov 24 18:21:40.478082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 813/1623] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:40 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:41.488668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:41.489656 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:41.498044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:41.498486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:41.499237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:41.499691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:41.599335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c3b48cb7-9ef6-4f2a-a672-6b2ca1a66887 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.114546 Nov 24 18:21:41.601495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 811/1624] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:41 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:42.611001 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:42.612120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:42.620958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:42.621393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:42.623225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:42.623225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:42.722414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f54a5ff1-d80c-45e2-ad62-09cf11a64aab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.114826 Nov 24 18:21:42.723591 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 814/1625] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:42 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:21:43.735575 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:43.736514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:43.745458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:43.745903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:43.746663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:43.747101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:43.838594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3cce28cf-77da-40b6-a97d-ec0bd98d98a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.107080 Nov 24 18:21:43.841670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 812/1626] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:43 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:44.850037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:44.851029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:44.858754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:44.859201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:44.859988 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:44.860418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:44.958752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d47d292-896f-4485-bdef-3a21dc2635d6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.112762 Nov 24 18:21:44.959417 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 815/1627] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:44 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:45.971682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:45.972743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:45.981002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:45.981443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:45.982205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:45.982631 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:46.083827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a234a252-db50-4bd5-9093-16eaf2d7d8e7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.116158 Nov 24 18:21:46.085215 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 813/1628] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:45 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:47.096184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:47.097170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:47.105643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:47.106025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:47.106784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:47.107211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:47.206906 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1cec773f-0b20-4647-8b70-2d0e19e602ea tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 14 microversion: 2.20 time: 0.114527 Nov 24 18:21:47.207412 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 816/1629] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:47 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:21:48.219526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:48.220546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:48.229624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:48.230293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:48.231724 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:48.232365 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:48.345247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3efa5d3b-5af9-4ed5-870b-f27d964f8a5e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 3741 microversion: 2.20 time: 0.129703 Nov 24 18:21:48.348293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 814/1630] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:48 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 3741 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:21:49.357075 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:49.358059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:49.365897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:49.366319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:49.367087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:49.367516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:49.475015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1cece25c-8ac1-4170-bf7e-ca47e828f100 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 15025 microversion: 2.20 time: 0.121102 Nov 24 18:21:49.475819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 817/1631] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:49 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 15025 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:50.486556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:50.487559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:50.495921 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:50.496372 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:50.497142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:50.497580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:50.606126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-30f2ceb8-6296-49ec-ab3b-290d045573dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 18356 microversion: 2.20 time: 0.123270 Nov 24 18:21:50.606943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 815/1632] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:50 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 18356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:51.618526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:51.619491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:51.627262 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:51.627728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:51.628472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:51.628894 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:51.743135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e2d32c52-45da-42d4-a008-25cf42a3389e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 19342 microversion: 2.20 time: 0.129134 Nov 24 18:21:51.746968 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 818/1633] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:51 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 19342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:52.755146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:52.756324 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:52.764205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:52.764653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:52.765413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:52.765895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:52.876293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e69df70f-6305-4f7d-be38-cf1869e48901 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 22217 microversion: 2.20 time: 0.125061 Nov 24 18:21:52.876974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 816/1634] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:52 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 22217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:53.888339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:53.890655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:53.898728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:53.899167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:53.899964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:53.900391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:54.013634 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-186fca7f-7f9b-470d-8cbc-ad7049668070 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 23804 microversion: 2.20 time: 0.129254 Nov 24 18:21:54.014279 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 819/1635] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:53 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 23804 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:55.025623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:55.026623 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:55.042474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:55.042474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:55.042474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:55.042474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:55.148613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-53e1c0ea-70dc-4f84-ae8b-1f49fe99c52c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 25284 microversion: 2.20 time: 0.126923 Nov 24 18:21:55.149182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 817/1636] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:55 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 25284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:56.160482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:56.161481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:56.170208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:56.170651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:56.171411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:56.171861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:56.284676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c42fcefd-8983-476c-874a-cfe252ee675f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 26759 microversion: 2.20 time: 0.128075 Nov 24 18:21:56.285293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 820/1637] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:56 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 26759 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:57.296677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:57.297777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:57.306892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:57.307335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:57.308134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:57.308567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:57.419525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c378cdcb-dd54-49f2-9e60-951f74054cf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 27640 microversion: 2.20 time: 0.126706 Nov 24 18:21:57.423221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 818/1638] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:57 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 27640 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:58.431882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:58.432863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:58.440661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:58.441093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:58.441844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:58.442337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:58.555390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2654c9b2-6b57-4fc2-8ea7-cfe7b7d6848e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28043 microversion: 2.20 time: 0.128384 Nov 24 18:21:58.558582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 821/1639] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:58 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28043 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:21:59.567450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:21:59.568624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:21:59.576222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:59.576666 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:59.577421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:21:59.577850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:21:59.709776 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-17548cf7-ad87-4b6c-a170-188c107924fb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28186 microversion: 2.20 time: 0.146169 Nov 24 18:21:59.710423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 819/1640] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:21:59 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28186 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:00.721415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:00.722393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:00.731076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:00.731511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:00.732296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:00.732723 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:00.831037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8d18c24b-2750-45b6-bf81-cf1201438701 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28186 microversion: 2.20 time: 0.113584 Nov 24 18:22:00.831689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 822/1641] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:00 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:01.844348 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:01.845271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:01.853790 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:01.854240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:01.855046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:01.855520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:01.970410 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-81e27fd4-5d37-4efb-a2ef-21cb7032b38b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28477 microversion: 2.20 time: 0.129992 Nov 24 18:22:01.971322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 820/1642] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:01 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28477 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:02.982244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:02.983237 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:02.992024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:02.992472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:02.993257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:02.993688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:03.101779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ba39e908-755c-47ba-8bcf-2fa636494022 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28645 microversion: 2.20 time: 0.123457 Nov 24 18:22:03.103839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 823/1643] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:02 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28645 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:04.114261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:04.115283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:04.123095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:04.123541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:04.124341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:04.124774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:04.223091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-727467fd-3df4-48cc-9ecc-8b28fa323073 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28645 microversion: 2.20 time: 0.112743 Nov 24 18:22:04.223657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 821/1644] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:04 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28645 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:05.234406 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:05.235393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:05.243137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:05.243583 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:05.244370 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:05.244799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:05.338518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a45ce1e9-289d-4685-b5ce-a171c4294677 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28645 microversion: 2.20 time: 0.107947 Nov 24 18:22:05.339374 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 824/1645] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:05 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28645 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:06.353162 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:06.354190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:06.362101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:06.362555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:06.363328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:06.363795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:06.465655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e1d9e7cc-8437-46fe-99db-264c23e62c1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28645 microversion: 2.20 time: 0.118290 Nov 24 18:22:06.466293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 822/1646] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:06 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:07.477776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:07.478764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:07.486586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:07.487025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:07.487887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:07.488315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:07.585457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-26edd9e3-62d3-43c7-878d-3f75e79a1c67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 28645 microversion: 2.20 time: 0.111458 Nov 24 18:22:07.586095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 825/1647] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:07 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 28645 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:08.597749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:08.598628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:08.606427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:08.606876 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:08.607659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:08.608093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:08.718501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-799c1e0e-2748-44e9-997e-d3f6891d99b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 29947 microversion: 2.20 time: 0.124775 Nov 24 18:22:08.719137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 823/1648] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:08 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 29947 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:09.731582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:09.732498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:09.741704 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:09.742146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:09.742924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:09.743356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:09.999444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7093bec9-bf07-41b1-ab50-c5426db8bbac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 32298 microversion: 2.20 time: 0.272426 Nov 24 18:22:10.000021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 826/1649] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:09 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 32298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:11.011895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:11.012893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:11.020738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:11.021184 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:11.021948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:11.022381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:11.134053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c6ab4ae0-7035-4f9d-9b75-314f9ea42f7d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 33318 microversion: 2.20 time: 0.126227 Nov 24 18:22:11.134594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 824/1650] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:11 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 33318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:12.146512 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:12.147655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:12.156083 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:12.156518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:12.157274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:12.157696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:12.278651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-948c8ac3-cd1a-4709-9182-ccbf526f35f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 34357 microversion: 2.20 time: 0.135964 Nov 24 18:22:12.279468 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 827/1651] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:12 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 34357 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:13.293742 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:13.294792 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:13.304830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:13.305424 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:13.306206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:13.306642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:13.417090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-704a4f1c-8650-423d-90da-7401f1ce0ade tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 35711 microversion: 2.20 time: 0.129640 Nov 24 18:22:13.421203 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 825/1652] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:13 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 35711 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:14.430396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:14.431381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:14.439263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:14.439727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:14.440486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:14.440909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:14.556560 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d40e47e7-0509-4206-9aff-ef5a1c163e9d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 37353 microversion: 2.20 time: 0.130902 Nov 24 18:22:14.557171 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 828/1653] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:14 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 37353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:15.570195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:15.571257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:15.579882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:15.580337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:15.581112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:15.581546 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:15.839449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f59fe156-9e35-4e7e-8d07-161ef57d0911 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 38199 microversion: 2.20 time: 0.273259 Nov 24 18:22:15.840111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 826/1654] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:15 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 38199 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:16.852749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:16.853742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:16.861608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:16.862045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:16.863070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:16.863502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:16.974568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b22a7641-d8c5-4a0e-a9c9-dc385dfaaf71 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 38199 microversion: 2.20 time: 0.126854 Nov 24 18:22:16.975190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 829/1655] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:16 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 38199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:17.986622 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:17.987644 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:17.995997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:17.996441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:17.997195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:17.997621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:18.108566 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b30c560c-6672-4834-b1d5-0a1c7c315abb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 38199 microversion: 2.20 time: 0.125804 Nov 24 18:22:18.109182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 827/1656] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:17 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 38199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:19.091952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:19.092525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:19.100347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.100785 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.101536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.101955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.121174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:19.122123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:19.129930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.130384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.131151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.131585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.161867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:22:19.243078 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b7cfb31f-16f3-4c91-a269-1572611dac2f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 200 len: 38340 microversion: 2.20 time: 0.125948 Nov 24 18:22:19.243735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 828/1657] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:22:19 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 38340 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:22:19.254426 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:19.254989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:19.263586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.264072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.264912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.265353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.276505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-52c73873-da90-4923-9c69-11bb86cb5f1c tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 204 len: 0 microversion: 2.1 time: 0.188180 Nov 24 18:22:19.277138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 830/1658] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:22:19 2021] DELETE /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:22:19.286699 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:19.287384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:19.294516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.294960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.295746 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:19.296176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:19.325321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4910d2b1-1820-4230-bdec-8ca7260b5a51 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/ips" status: 200 len: 151 microversion: 2.20 time: 0.074909 Nov 24 18:22:19.325887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 829/1659] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Nov 24 18:22:19 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/ips => generated 151 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 18:22:19.627995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:19.640180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b761420d-e55b-4788-88cb-52ab31e55bbb tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1669 microversion: 2.1 time: 0.357657 Nov 24 18:22:19.650860 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 831/1660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:22:19 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:22:20.669031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:20.670325 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:20.701928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:20.702679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:20.703475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:20.704437 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:20.844284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7737fd07eb864a5ba258d1892474542f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4275b2353e804c9e9365d6f9ff69fb04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:22:20.853238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d8a5596a-ccdf-416d-8d61-e014cd2c9ab1 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 200 len: 1602 microversion: 2.1 time: 0.198563 Nov 24 18:22:20.859000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 830/1661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:22:20 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 1602 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:22:21.223554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-dd98a6d8-0a67-40dd-b554-907bb0b781bb req-35e3f8cf-3898-4781-b5a8-caaa2e64bc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc1dcde-4d03-4fde-b034-be9d70cd2aa4", "name": "network-vif-deleted", "tag": "3cb4783c-6d29-4fbc-af98-6c3ee3207737"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:22:21.225491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:22:21.225491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:22:21.234222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-dd98a6d8-0a67-40dd-b554-907bb0b781bb req-35e3f8cf-3898-4781-b5a8-caaa2e64bc65 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:21.234688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-dd98a6d8-0a67-40dd-b554-907bb0b781bb req-35e3f8cf-3898-4781-b5a8-caaa2e64bc65 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:21.252527 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-dd98a6d8-0a67-40dd-b554-907bb0b781bb req-35e3f8cf-3898-4781-b5a8-caaa2e64bc65 service nova] Creating event network-vif-deleted:3cb4783c-6d29-4fbc-af98-6c3ee3207737 for instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 on hv-cinder-81857 Nov 24 18:22:21.258452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-dd98a6d8-0a67-40dd-b554-907bb0b781bb req-35e3f8cf-3898-4781-b5a8-caaa2e64bc65 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038555 Nov 24 18:22:21.259033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 832/1662] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:22:21.872416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:21.873151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:22:21.881033 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:21.881862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:21.883659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:22:21.884381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:22:21.937342 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. Nov 24 18:22:21.937957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:22:21.938918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90419eec-23f5-4023-aaab-0b7998a22c02 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 404 len: 111 microversion: 2.1 time: 0.071610 Nov 24 18:22:21.939983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 831/1663] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:22:21 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:22:21.948205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c0e413cb-cfc7-40b1-8023-77fb704d1183 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '.version_select at 0x7f8b10aafe50>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:22:21.980426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c0e413cb-cfc7-40b1-8023-77fb704d1183 tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137535657" status: 202 len: 0 microversion: 2.1 time: 0.036035 Nov 24 18:22:21.981411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 833/1664] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Nov 24 18:22:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137535657 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:22:29.465480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:22:29.466077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:22:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:24:12.542109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:24:12.542605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:24:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:24:22.546506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:24:22.546966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:24:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:24:48.645887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:24:48.646464 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:48.657984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:48.658384 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:48.659435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:48.660064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:48.732416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lazy-loading 'flavor' on Instance uuid ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:24:49.257675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9b901ccd-195b-451c-86bd-4601b4d39e31 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 202 len: 0 microversion: 2.20 time: 0.615646 Nov 24 18:24:49.258751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 832/1665] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:24:48 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:24:49.266525 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 24 18:24:49.270285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:49.271120 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:49.280690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:49.281227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:49.282178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:49.282812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:49.674106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:49.683280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:49.685010 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:49.686213 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1d593dcb-3022-467c-83ab-02aa741cf877 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.422570 Nov 24 18:24:49.686972 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 834/1666] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:49 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:50.702880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:24:50.706605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:50.707310 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:50.714695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:50.715150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:50.716459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:50.716897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:50.929222 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:50.941373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:50.942866 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:50.944489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-64daa68b-fe40-4d15-a966-d8110b13acf2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.242964 Nov 24 18:24:50.945682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 833/1667] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:50 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:51.964003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:51.964599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:51.983836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:51.984276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:51.985031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:51.985451 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:52.019517 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38618. Nov 24 18:24:52.191556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:52.203556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:52.205081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:52.206222 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9c9606a0-1458-4b15-9dea-cf4efb44fe52 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.245932 Nov 24 18:24:52.206764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 835/1668] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:51 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:53.225729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:53.226346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:53.244443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:53.244892 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:53.245668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:53.246099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:53.305416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38640. Nov 24 18:24:53.456823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:53.465492 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:53.467234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:53.468401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8446cb2d-0139-4bc7-a93e-37412eda8ee4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.246478 Nov 24 18:24:53.468928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 834/1669] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:53 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:54.487464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:54.488085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:54.495262 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:54.495727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:54.496478 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:54.496918 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:54.508570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:24:54.513900 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:24:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d (ip 10.222.0.64) !!! Nov 24 18:24:54.713238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:54.723647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:54.725318 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:54.726438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a7c26a5d-fced-4732-aa5b-4ede6a53ca2a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.242643 Nov 24 18:24:54.726971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 836/1670] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:54 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:24:55.743992 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:55.744697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:55.751864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:55.752316 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:55.753087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:55.753528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:55.955120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:55.963884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:55.965364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:55.966602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7e1596f5-6cd3-41e3-848f-a9dab38ee0f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.226162 Nov 24 18:24:55.967264 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 835/1671] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:55 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:56.985205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:56.985800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:56.993457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:56.993837 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:56.994598 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:56.995028 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:57.196519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:57.205845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:57.207314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:57.208452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1cc799b3-c8e7-4004-8bf4-ef8cc8d712da tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.227543 Nov 24 18:24:57.209176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 837/1672] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:56 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:58.226275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:58.227700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:58.235728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:58.236175 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:58.236940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:58.237396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:58.452747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:58.461382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:58.463013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:58.464160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ce341cc6-54b1-43cb-9c3d-3d1a4c5c9962 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.241909 Nov 24 18:24:58.464690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 836/1673] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:58 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:24:59.482268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:24:59.482744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:24:59.490307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:59.490798 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:59.491728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:24:59.492226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:24:59.701770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:59.710659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:59.712193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:24:59.713478 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-364d68f9-8d7d-4956-bbdd-97372f08b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.235218 Nov 24 18:24:59.714023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 838/1674] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:24:59 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:00.732750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:00.733707 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:00.741352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:00.741790 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:00.742547 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:00.742977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:00.945240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:00.955551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:00.957551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:00.958899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cd639669-d22e-4fe3-bf16-371a8d7603f7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1743 microversion: 2.20 time: 0.230517 Nov 24 18:25:00.959780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 837/1675] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:00 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:01.977094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:01.978208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:01.986622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:01.987057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:01.987841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:01.988265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:02.203913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:02.216402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:02.218400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:02.219524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5b27a914-4793-47c5-838f-d1faaf9b96b3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.246179 Nov 24 18:25:02.220087 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 839/1676] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:01 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:03.242079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:03.242678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:03.263258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:03.264309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:03.265091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:03.265522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:03.516304 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:03.526074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:03.527649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:03.530007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5ed84a5a-35f7-447f-b22e-9c12477c5281 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.290922 Nov 24 18:25:03.530883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 838/1677] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:03 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:25:03.793441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-cb5c60fb-afcc-4c55-952e-9ee6ddd822c7 req-cc9cefeb-d8de-4a7a-bb8a-287c4c2817d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "name": "network-vif-plugged", "status": "completed", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:03.795408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:25:03.795408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:25:03.821108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-cb5c60fb-afcc-4c55-952e-9ee6ddd822c7 req-cc9cefeb-d8de-4a7a-bb8a-287c4c2817d9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:03.830696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-cb5c60fb-afcc-4c55-952e-9ee6ddd822c7 req-cc9cefeb-d8de-4a7a-bb8a-287c4c2817d9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:03.882194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-cb5c60fb-afcc-4c55-952e-9ee6ddd822c7 req-cc9cefeb-d8de-4a7a-bb8a-287c4c2817d9 service nova] Creating event network-vif-plugged:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:25:03.906556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-cb5c60fb-afcc-4c55-952e-9ee6ddd822c7 req-cc9cefeb-d8de-4a7a-bb8a-287c4c2817d9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113999 Nov 24 18:25:03.909693 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 840/1678] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:04.548930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:04.549536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:04.558853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:04.559317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:04.560314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:04.560909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:04.780951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:04.793151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:04.795438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:04.796635 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e08dd947-785a-4e3f-97e5-f28f7cf277ec tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.251429 Nov 24 18:25:04.797503 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 839/1679] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:04 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:05.815952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:05.816844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:05.826157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:05.826904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:05.828698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:05.829198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:06.064502 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:06.073806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:06.076379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:06.077642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-348e3dea-ad72-4239-9cd0-1d0b54fd82ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.266463 Nov 24 18:25:06.078285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 841/1680] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:05 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:07.096483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:07.097164 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:07.107987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:07.108673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:07.109615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:07.110195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:07.538593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:07.549639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:07.551812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:07.552952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a579794a-3bc5-4bdc-b295-1f36e4a8b90c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.460164 Nov 24 18:25:07.575956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 840/1681] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:07 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:08.574741 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:08.576060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:08.583927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:08.584362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:08.585121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:08.585796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:08.841039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:08.850928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:08.852439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:08.853674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-74f6d255-9dc9-49cc-835f-3b405b96e668 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.282632 Nov 24 18:25:08.854223 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 842/1682] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:08 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:09.877518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:09.879064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:09.886779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:09.887227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:09.892918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:09.893371 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:10.140597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:10.149765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:10.151402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:10.154360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-aca3d32a-cfb6-4829-8bd5-2259a990b546 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.279495 Nov 24 18:25:10.155187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 841/1683] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:09 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:11.176287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:11.176881 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:11.188675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:11.189105 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:11.189873 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:11.190298 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:11.442602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:11.455026 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:11.457787 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:11.459319 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7f03e926-a274-49b2-b647-5ce9b38ddb82 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1738 microversion: 2.20 time: 0.288182 Nov 24 18:25:11.460096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 843/1684] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:11 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:12.478072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:12.478701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:12.486545 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:12.486997 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:12.487805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:12.488302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:12.743472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:12.753510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:12.755099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:12.756335 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f1d5ba59-8a57-4678-96e5-ec46557d7860 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1720 microversion: 2.20 time: 0.282033 Nov 24 18:25:12.757323 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 842/1685] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:12 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:13.776813 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:13.777505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:13.784743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:13.785177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:13.785932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:13.786354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:13.988172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:13.997648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:13.999127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:14.000317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-888bb375-e293-4d2e-8e88-a8e542ae91eb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1720 microversion: 2.20 time: 0.227305 Nov 24 18:25:14.000877 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 844/1686] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:13 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:15.019130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:15.020297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:15.031778 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:15.032233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:15.033071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:15.033483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:15.243103 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:15.254064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:15.255771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:15.256983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0323f7b1-af32-4375-8dc8-13f5cd17eb1d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1720 microversion: 2.20 time: 0.241849 Nov 24 18:25:15.257774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 843/1687] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:15 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:15.573832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-65ee5ffd-934d-4a47-8f0d-9f27df75d098 req-b2787611-4c77-4d36-80bf-952d087e4e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:15.576903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:25:15.576903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:25:15.586210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-65ee5ffd-934d-4a47-8f0d-9f27df75d098 req-b2787611-4c77-4d36-80bf-952d087e4e81 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:15.586745 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-65ee5ffd-934d-4a47-8f0d-9f27df75d098 req-b2787611-4c77-4d36-80bf-952d087e4e81 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:15.603620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-65ee5ffd-934d-4a47-8f0d-9f27df75d098 req-b2787611-4c77-4d36-80bf-952d087e4e81 service nova] Creating event network-vif-unplugged:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:25:15.608692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-65ee5ffd-934d-4a47-8f0d-9f27df75d098 req-b2787611-4c77-4d36-80bf-952d087e4e81 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038689 Nov 24 18:25:15.609243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 845/1688] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:25:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:16.275981 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:16.276695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:16.291022 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:16.291840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:16.292629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:16.293055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:16.610674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:16.619363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:16.620971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:16.622835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d0901927-2cc7-48ae-9775-cc6237789601 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1663 microversion: 2.20 time: 0.350829 Nov 24 18:25:16.623511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 844/1689] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:16 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1663 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:16.641917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d3cfb2b-7eba-4515-b77a-da7a59e18a19"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:16.643218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:16.651185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:16.651653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:16.652426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:16.653664 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:17.136117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d0b836da-8c0f-4d2a-be8c-d1cbdae029df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.498991 Nov 24 18:25:17.137234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 846/1690] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Nov 24 18:25:16 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments => generated 188 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:25:17.355035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:17.356251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:17.364337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:17.364703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:17.365694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:17.366274 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:17.532187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fc3210a4-0ba6-40ac-991e-457bd9d038f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action" status: 202 len: 0 microversion: 2.20 time: 0.181159 Nov 24 18:25:17.533361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 845/1691] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:25:17 2021] POST /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:25:17.541308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:17.542257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:17.552234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:17.552780 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:17.553653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:17.554184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:17.925351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:17.936022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:17.937770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:17.939146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7cb00c28-ec70-4117-81f4-6806e0eca3ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1749 microversion: 2.20 time: 0.401574 Nov 24 18:25:17.946362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 847/1692] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:17 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1749 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:18.967531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:18.970255 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:18.994768 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:18.997980 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:19.000608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:19.001658 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:19.230613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:19.242913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:19.244808 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:19.245943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7f608830-7978-4503-ad62-db80972dc265 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1751 microversion: 2.20 time: 0.283235 Nov 24 18:25:19.247327 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 846/1693] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:18 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:20.267160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:20.267797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:20.275678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:20.276129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:20.276970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:20.277597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:20.531191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:20.540947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:20.544224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:20.545240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a493ad57-6e2c-4129-9348-79343192ffd8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.282880 Nov 24 18:25:20.545823 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 848/1694] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:20 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:21.565449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:21.566650 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:21.579107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:21.582460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:21.583492 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:21.585455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:22.133806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:22.146629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:22.148422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:22.149580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d3ca736a-6a51-4bc6-985d-b6c6a41a44ac tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.588495 Nov 24 18:25:22.150135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 847/1695] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:21 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:23.172420 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:23.173772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:23.196594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:23.197565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:23.199293 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:23.200832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:23.632205 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:23.644641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:23.646529 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:23.655286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2de3bae0-f570-451e-ada0-c4b807b4c0e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.482738 Nov 24 18:25:23.659295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 849/1696] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:23 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:24.678293 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:24.678896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:24.699043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:24.699748 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:24.700600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:24.701038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:25.057346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:25.069750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:25.085032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:25.089689 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c67ebfad-5a98-4a58-8994-8182981f5238 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.414366 Nov 24 18:25:25.092138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 848/1697] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:24 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:26.112931 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:26.114147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:26.136286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:26.144362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:26.145442 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:26.146030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:26.984317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:27.019381 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:27.036600 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:27.038332 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4977f8f1-148c-4425-9373-21e3016d907a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.929446 Nov 24 18:25:27.043467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 850/1698] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:26 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:28.062329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:28.062934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:28.089305 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:28.090930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:28.092057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:28.092637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:28.521048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:28.537938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:28.549192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:28.550936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-100b89b4-3c18-4cfb-b563-2129eae72a91 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.493501 Nov 24 18:25:28.551478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 849/1699] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:28 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:29.569391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:29.570775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:29.580060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:29.580824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:29.581738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:29.582335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:29.908225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:29.933498 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:29.936359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:29.937754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3bf2d4bf-9972-423e-b498-a542d0b38821 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.372283 Nov 24 18:25:29.948594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 851/1700] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:29 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:30.971646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:30.972649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:30.988903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:30.989366 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:30.990167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:30.990603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:31.322570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:31.333909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:31.335752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:31.336848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d572bdce-0180-466e-a09f-52a5283188e9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.382762 Nov 24 18:25:31.347955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 850/1701] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:30 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:32.355514 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:32.356849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:32.365876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:32.366674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:32.367810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:32.368450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:32.898325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:32.916994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:32.919064 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:32.920233 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b24d13a8-a928-4d26-a873-e37095ab0e9e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.568696 Nov 24 18:25:32.920990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 852/1702] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:32 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:33.836922 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Action: 'create', calling method: .version_select at 0x7f8b0b7705e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1422889255"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:33.862098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for project 64beedb83ebb48e291cc631a123c1504. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:25:33.866193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for user 16803f607a6e43f1827f06bfc03421a0 and project 64beedb83ebb48e291cc631a123c1504. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:25:33.938976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:33.940187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:33.947528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:33.948229 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:33.949157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:33.949865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:34.141250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:34.150339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:34.151855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:34.153485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9ed9aef9-0c11-4c8c-a3b8-06bc3a5bb8c1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.218614 Nov 24 18:25:34.154023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 853/1703] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:33 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:25:34.286128 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for project 64beedb83ebb48e291cc631a123c1504. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:25:34.291188 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for user 16803f607a6e43f1827f06bfc03421a0 and project 64beedb83ebb48e291cc631a123c1504. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:25:34.305179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a6aca2e7-ef59-47f8-804e-fb620f8fd924 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.645372 Nov 24 18:25:34.305759 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 851/1704] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Nov 24 18:25:33 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:35.172940 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:35.174193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:35.182648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:35.183363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:35.184751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:35.185615 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:35.424644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:35.437650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:35.439765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:35.441127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d2b1d6ac-c052-4dc1-8416-5305203466ad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.272089 Nov 24 18:25:35.442158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 854/1705] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:35 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:25:36.469691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:36.470819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:36.485147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:36.485598 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:36.486383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:36.486821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:36.716134 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:36.726138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:36.727638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:36.730100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5d02af48-69d8-437b-8c3b-d6f6694a6236 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.266597 Nov 24 18:25:36.731052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 852/1706] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:36 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:37.749278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:37.749832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:37.757246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:37.757676 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:37.758426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:37.758849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:37.968692 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:37.977670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:37.979216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:37.981063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3705ab01-ed3a-4786-bc6c-5b05a1a48a33 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.235057 Nov 24 18:25:37.981685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 855/1707] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:37 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:39.013362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:39.014130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:39.021551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:39.022014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:39.022802 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:39.023258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:39.227167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:39.236362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:39.237858 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:39.238995 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-10567968-d8ee-4a98-920a-0ec594e28bdf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.233113 Nov 24 18:25:39.241819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 853/1708] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:39 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:40.257643 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:40.258188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:40.266474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:40.266911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:40.267703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:40.268131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:40.466362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:40.475768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:40.477257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:40.478439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-331d48dc-c3bb-4fe6-b9bb-0a64db76a4ae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.224643 Nov 24 18:25:40.478910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 856/1709] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:40 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:41.497116 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:41.498368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:41.505957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:41.506386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:41.507138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:41.507564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:41.710098 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:41.719637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:41.721111 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:41.722219 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2bf4cb28-9986-4847-aeb7-806888063ce4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.228777 Nov 24 18:25:41.722770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 854/1710] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:41 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:42.741976 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:42.742603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:42.750589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:42.751039 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:42.751845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:42.752278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:42.955863 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:42.964924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:42.966398 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:42.967761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b3567fcc-dc77-4ec0-a323-00b7e6b953e1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.229305 Nov 24 18:25:42.968311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 857/1711] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:42 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:43.986025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:43.986629 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:43.994176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:43.994617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:43.995362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:43.995823 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:44.207583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:44.216733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:44.219799 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:44.220939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8a0f11f2-161d-4dfe-bf80-ad4a7ab4d164 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.238666 Nov 24 18:25:44.231562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 855/1712] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:43 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:45.239070 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:45.239620 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:45.246739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:45.247170 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:45.247950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:45.248861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:45.455795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:45.465606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:45.467127 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:45.469015 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dd33386d-8df2-4742-b83c-d2d4b192ddf7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.233492 Nov 24 18:25:45.469582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 858/1713] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:45 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:45.732035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-fd303b69-61df-4120-a3d9-0a7823aa6de7 req-8abc53f3-8e19-40ae-a320-2af41e3a1aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "name": "network-vif-plugged", "status": "completed", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:45.733965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:25:45.733965 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:25:45.742286 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-fd303b69-61df-4120-a3d9-0a7823aa6de7 req-8abc53f3-8e19-40ae-a320-2af41e3a1aed service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:45.742729 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-fd303b69-61df-4120-a3d9-0a7823aa6de7 req-8abc53f3-8e19-40ae-a320-2af41e3a1aed service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:45.758774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-fd303b69-61df-4120-a3d9-0a7823aa6de7 req-8abc53f3-8e19-40ae-a320-2af41e3a1aed service nova] Creating event network-vif-plugged:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:25:45.763556 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-fd303b69-61df-4120-a3d9-0a7823aa6de7 req-8abc53f3-8e19-40ae-a320-2af41e3a1aed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 Nov 24 18:25:45.765006 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 856/1714] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:25:46.487905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:46.488511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:46.496362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:46.496795 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:46.497544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:46.497967 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:46.702434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:46.711418 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:46.712921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:46.714035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fe895ab4-71ca-4b19-8ef4-df74be52f79a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.229849 Nov 24 18:25:46.714574 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 859/1715] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:46 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:47.735158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:47.736509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:47.744703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:47.745391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:47.746358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:47.747429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:47.972836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:47.987537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:47.989884 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:47.991584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1086ac93-5884-4e13-9d8f-66c14acd9b7c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1807 microversion: 2.20 time: 0.261140 Nov 24 18:25:47.992422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 857/1716] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:47 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1807 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:49.016602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:49.017206 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:49.024384 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:49.024828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:49.025585 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:49.026031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:49.218422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:49.227425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:49.228949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:49.230054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-027dbf3b-9547-477b-a28d-eaa48bd8f9f4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1794 microversion: 2.20 time: 0.217844 Nov 24 18:25:49.230607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 860/1717] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:25:49 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1794 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:25:52.622794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1378474934", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1422889255", "security_groups": [{"name": "tempest-secgroup-smoke-679808761"}], "networks": [{"uuid": "6a82aaae-7621-4c12-b65a-42579210ef49"}], "block_device_mapping_v2": [{"uuid": "a1cb26c3-4eb0-47da-9ea6-5a3213413176", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:52.795763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] validate_networks() for [('6a82aaae-7621-4c12-b65a-42579210ef49', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:25:53.530517 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:25:53.530929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:25:53.531392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:25:53.532433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:25:53.533349 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:25:53.542706 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:53.543560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:53.544394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:53.544827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:53.562883 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for project 64beedb83ebb48e291cc631a123c1504. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:25:53.566982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Getting quotas for user 16803f607a6e43f1827f06bfc03421a0 and project 64beedb83ebb48e291cc631a123c1504. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:25:53.665752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:25:53.667933 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1cb26c3-4eb0-47da-9ea6-5a3213413176',volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:25:53.847786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cd08c4d3-f4dc-44d1-af52-b18c72f7864e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.228588 Nov 24 18:25:53.848432 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 858/1718] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:25:52 2021] POST /compute/v2.1/servers => generated 405 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:25:53.858441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b66e3ce8-d412-48e7-8abc-0cf4ab55cd48 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:53.859047 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b66e3ce8-d412-48e7-8abc-0cf4ab55cd48 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:53.931501 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b66e3ce8-d412-48e7-8abc-0cf4ab55cd48 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:53.939363 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b66e3ce8-d412-48e7-8abc-0cf4ab55cd48 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1089 microversion: 2.1 time: 0.084635 Nov 24 18:25:53.939948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 861/1719] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:53 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:54.957401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:54.958670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:54.970136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:54.970594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:54.971375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:54.971819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:55.101634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:55.110008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-45d1f96a-7773-4a5f-83ad-f1917700327d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1205 microversion: 2.1 time: 0.157545 Nov 24 18:25:55.110727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 859/1720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:54 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1205 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:56.127059 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:56.127710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:56.135382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:56.136403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:56.136754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:56.137190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:56.342758 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:56.352160 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1a82850f-e749-4da2-9d60-61b953706af9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.229584 Nov 24 18:25:56.352750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 862/1721] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:56 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:57.016926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-73ac4b93-62c5-474e-8dfe-5e031e24114a req-888d0b73-1b37-4c68-8c72-ab37bf5c221d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:25:57.018518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:25:57.018518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:25:57.027129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-73ac4b93-62c5-474e-8dfe-5e031e24114a req-888d0b73-1b37-4c68-8c72-ab37bf5c221d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:57.027565 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-73ac4b93-62c5-474e-8dfe-5e031e24114a req-888d0b73-1b37-4c68-8c72-ab37bf5c221d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:57.045462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-73ac4b93-62c5-474e-8dfe-5e031e24114a req-888d0b73-1b37-4c68-8c72-ab37bf5c221d service nova] Creating event network-changed:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:25:57.052024 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-73ac4b93-62c5-474e-8dfe-5e031e24114a req-888d0b73-1b37-4c68-8c72-ab37bf5c221d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100618 Nov 24 18:25:57.052970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 860/1722] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:25:57.370057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:57.370762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:57.378186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:57.378613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:57.379389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:57.379914 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:57.596511 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:57.606295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-177e3d3f-5c52-41ee-8bdc-c6e13a7bbd26 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.239797 Nov 24 18:25:57.606854 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 863/1723] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:57 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:58.623140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:58.624142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:58.632112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:58.632555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:58.633311 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:58.633807 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:58.852693 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:25:58.861124 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d950bede-9daf-485a-b79c-ddefbeba0de9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.241935 Nov 24 18:25:58.861690 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 861/1724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:58 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:25:59.877865 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:25:59.878464 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:25:59.885884 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:59.886316 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:25:59.887117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:25:59.887541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:00.082814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:00.090919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-38f31ede-7e0c-4176-b641-3faf6fa7f7f1 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.217142 Nov 24 18:26:00.091490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 864/1725] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:25:59 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:01.108212 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:01.108760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:01.116064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:01.116518 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:01.117279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:01.117715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:01.315433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:01.323619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-71a30261-1c3e-48f1-9309-51c6b527f3c9 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.219127 Nov 24 18:26:01.324180 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 862/1726] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:01 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:02.340238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:02.340839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:02.348957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:02.349393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:02.350138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:02.350561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:02.547876 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:02.556065 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bf10b78f-6ffe-4152-bf15-945add5fd33e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.219434 Nov 24 18:26:02.556614 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 865/1727] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:02 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:03.573062 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:03.573668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:03.581829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:03.582271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:03.583041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:03.583473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:03.779150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:03.787711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1a7518fa-c5b2-4972-92b1-f9bff81c50f5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.218445 Nov 24 18:26:03.788272 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 863/1728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:03 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:04.804619 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:04.805214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:04.812411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:04.813140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:04.813735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:04.814158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:05.100312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:05.108257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5a633753-c14c-4430-b13c-c1bea00d1c16 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.307415 Nov 24 18:26:05.108809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 866/1729] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:04 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:06.124821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:06.125943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:06.133131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:06.133567 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:06.134314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:06.134737 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:06.331252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:06.339434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8062c114-55aa-46b4-961f-ce073df0268d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.218335 Nov 24 18:26:06.340031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 864/1730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:06 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:07.356124 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:07.356718 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:07.364973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:07.365413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:07.366161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:07.366582 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:07.576928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:07.596266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c825f1eb-64e6-4393-8abd-672b4d852a66 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.243720 Nov 24 18:26:07.596852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 867/1731] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:07 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:07.908586 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-245c6f2e-8a1c-49c1-9044-18085c8fa003 req-246a4efb-3e37-4640-b7b1-c353aee0b85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "name": "network-vif-plugged", "status": "completed", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:07.910545 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:07.910545 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:26:07.920275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-245c6f2e-8a1c-49c1-9044-18085c8fa003 req-246a4efb-3e37-4640-b7b1-c353aee0b85a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:07.920705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-245c6f2e-8a1c-49c1-9044-18085c8fa003 req-246a4efb-3e37-4640-b7b1-c353aee0b85a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:07.936771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-245c6f2e-8a1c-49c1-9044-18085c8fa003 req-246a4efb-3e37-4640-b7b1-c353aee0b85a service nova] Creating event network-vif-plugged:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:26:07.942560 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-245c6f2e-8a1c-49c1-9044-18085c8fa003 req-246a4efb-3e37-4640-b7b1-c353aee0b85a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037751 Nov 24 18:26:07.943178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 865/1732] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:08.613613 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:08.614207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:08.621376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:08.621814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:08.622760 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:08.623303 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:08.821782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:08.830544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-160dd505-c90e-4974-902d-565302f07f44 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1260 microversion: 2.1 time: 0.221235 Nov 24 18:26:08.831137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 868/1733] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:08 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:09.847893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:09.848583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:09.856159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:09.856596 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:09.857385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:09.857812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:10.079462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:10.088649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-eab3d650-7a44-47cc-8508-a7dd38e78ee8 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1443 microversion: 2.1 time: 0.245052 Nov 24 18:26:10.089210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 866/1734] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:09 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1443 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:10.105019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:10.105627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:10.113556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:10.113994 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:10.114751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:10.115173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:10.324349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:10.334926 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6dc16054-d335-4356-a0b3-3b3bd38d6460 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1443 microversion: 2.1 time: 0.233441 Nov 24 18:26:10.335484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 869/1735] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:26:10 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1443 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:13.099764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-4715ad3f-8d02-46ce-851e-a2117f8cc5ef req-75412278-87b6-44a2-9125-235adc0283ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:13.101393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:13.101393 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:26:13.110779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-4715ad3f-8d02-46ce-851e-a2117f8cc5ef req-75412278-87b6-44a2-9125-235adc0283ca service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:13.111360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-4715ad3f-8d02-46ce-851e-a2117f8cc5ef req-75412278-87b6-44a2-9125-235adc0283ca service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:13.127397 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-4715ad3f-8d02-46ce-851e-a2117f8cc5ef req-75412278-87b6-44a2-9125-235adc0283ca service nova] Creating event network-changed:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:26:13.132243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-4715ad3f-8d02-46ce-851e-a2117f8cc5ef req-75412278-87b6-44a2-9125-235adc0283ca service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036451 Nov 24 18:26:13.132898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 867/1736] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:22.485401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:22.485899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:22.493101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.493545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:22.494304 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.494732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:22.558099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a103f19-a3d3-4024-9760-aa9772c31271 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments/0d3cfb2b-7eba-4515-b77a-da7a59e18a19" status: 200 len: 194 microversion: 2.20 time: 0.077151 Nov 24 18:26:22.558705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 870/1737] 10.222.0.64 () {60 vars in 1453 bytes} [Wed Nov 24 18:26:22 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments/0d3cfb2b-7eba-4515-b77a-da7a59e18a19 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:26:22.663394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:22.664039 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:22.672340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.672755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:22.673740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.674321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:22.837603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lazy-loading 'services' on Instance uuid ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:26:22.973967 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-500bd702-eafa-4714-918e-0d1b60305ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments/0d3cfb2b-7eba-4515-b77a-da7a59e18a19" status: 202 len: 0 microversion: 2.20 time: 0.314518 Nov 24 18:26:22.974538 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 868/1738] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Nov 24 18:26:22 2021] DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments/0d3cfb2b-7eba-4515-b77a-da7a59e18a19 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:26:22.982597 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:22.984403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:22.991732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.992173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:22.992938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:22.993555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:23.063076 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-db31bfb5-10ed-463d-9c6c-85554a0936dc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084167 Nov 24 18:26:23.063644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 871/1739] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Nov 24 18:26:22 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:26:24.201636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:24.203330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:24.210765 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.211213 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.212002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.212442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.277383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-712246c8-dd5a-4273-8d2f-86b205abb2a4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.206444 Nov 24 18:26:24.277929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 869/1740] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Nov 24 18:26:24 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d/os-volume_attachments => generated 25 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:24.378706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:24.379256 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:24.386466 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.386898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.387678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.388109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.448748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:26:24.560315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-44b4ab1c-d825-4af0-ac1f-0e3b5e28821f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 204 len: 0 microversion: 2.20 time: 0.185644 Nov 24 18:26:24.561201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 872/1741] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Nov 24 18:26:24 2021] DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:26:24.570784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:24.571592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:24.579008 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.579452 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.580233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:24.580664 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:24.781549 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:24.790050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:24.791531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:24.792662 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-735d5894-9286-4e4a-9bfb-3bab2b2e8174 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.225700 Nov 24 18:26:24.793206 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 870/1742] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:24 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:25.812216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:25.812937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:25.820126 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:25.820565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:25.821314 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:25.821743 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:26.020545 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:26.030504 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:26.032077 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:26.033951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-026558f1-c94b-4fdb-b378-b6e76d8417e3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1722 microversion: 2.20 time: 0.226005 Nov 24 18:26:26.034507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 873/1743] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:25 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:27.052657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:27.053275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:27.060433 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:27.060886 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:27.061687 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:27.062123 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:27.242247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:27.251718 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:27.253204 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:27.254849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-955db594-db30-4184-a30a-f9281aafa590 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1654 microversion: 2.20 time: 0.205839 Nov 24 18:26:27.255786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 871/1744] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:27 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1654 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:27.756577 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-037436e6-bd69-49d3-9471-04bb4926d9f0 req-98b6bab8-aea2-427f-9537-7f40430b406d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d", "name": "network-vif-deleted", "tag": "d53e85b1-8c8f-4c11-8893-3ba3f648e9d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:27.758258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:27.758258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:26:27.767799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-037436e6-bd69-49d3-9471-04bb4926d9f0 req-98b6bab8-aea2-427f-9537-7f40430b406d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:27.768231 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-037436e6-bd69-49d3-9471-04bb4926d9f0 req-98b6bab8-aea2-427f-9537-7f40430b406d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:27.790054 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-037436e6-bd69-49d3-9471-04bb4926d9f0 req-98b6bab8-aea2-427f-9537-7f40430b406d service nova] Creating event network-vif-deleted:d53e85b1-8c8f-4c11-8893-3ba3f648e9d6 for instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d on hv-cinder-81857 Nov 24 18:26:27.795414 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-037436e6-bd69-49d3-9471-04bb4926d9f0 req-98b6bab8-aea2-427f-9537-7f40430b406d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042234 Nov 24 18:26:27.796594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 874/1745] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:28.274388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:28.275054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:28.283591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:28.284070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:28.284904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:28.285360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:28.365360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:28.365910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:28.366369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lazy-loading 'fault' on Instance uuid ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:26:28.457170 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:28.466709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:28.469094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:28.470388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-571958d6-f10c-46d4-a209-13b56391adab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 200 len: 1370 microversion: 2.20 time: 0.200361 Nov 24 18:26:28.475850 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 872/1746] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:28 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:29.488400 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:29.489080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:29.496306 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:29.496738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:29.497477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:29.497895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:29.549670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. Nov 24 18:26:29.550522 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:26:29.551326 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0c84fb5c-b329-439d-a67d-b3e5c69a0147 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 404 len: 111 microversion: 2.20 time: 0.067115 Nov 24 18:26:29.551899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 875/1747] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:29 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 18:26:29.560032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4e2c5d6a-9004-4d3c-a25e-faf98a41c468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '.version_select at 0x7f8b0b770700>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:29.576655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4e2c5d6a-9004-4d3c-a25e-faf98a41c468 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-652726012" status: 204 len: 0 microversion: 2.20 time: 0.020151 Nov 24 18:26:29.577674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 873/1748] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Nov 24 18:26:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-652726012 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:26:30.655794 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: .version_select at 0x7f8b10142f70>, body: {"keypair": {"name": "tempest-keypair-1363597140"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:30.681167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:26:30.685004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:26:30.845345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:26:30.849276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'key_pairs'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:26:30.863194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e2765f3e-687a-4b58-8715-e1fd6d015713 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.211678 Nov 24 18:26:30.863844 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 876/1749] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Nov 24 18:26:30 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:26:32.590819 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1741651422", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3ce9ad89-4e1b-4004-865a-96f49d2d4197"}], "security_groups": [{"name": "tempest-securitygroup--1759838607"}], "key_name": "tempest-keypair-1363597140", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:32.718563 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] validate_networks() for [('3ce9ad89-4e1b-4004-865a-96f49d2d4197', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:26:33.257362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:26:33.257797 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:26:33.258252 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:26:33.258655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:26:33.259090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:26:33.267540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:33.268007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:33.268800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:33.269226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:33.286536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for project d25c25f0344f48eea568f2eb414698a9. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:26:33.290471 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Getting quotas for user 332aad97cf964e0287bd5cfee8d15e1b and project d25c25f0344f48eea568f2eb414698a9. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:26:33.302038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:26:33.304339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:26:33.349603 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8f1a587-32a8-44a9-911b-7d132bc11a20 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.762827 Nov 24 18:26:33.350236 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 874/1750] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Nov 24 18:26:32 2021] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 24 18:26:33.361198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:33.361959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:33.438253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:33.447647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:33.449178 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:33.450355 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e3213676-f723-4abe-b842-139eec12178e tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1282 microversion: 2.20 time: 0.093990 Nov 24 18:26:33.450895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 877/1751] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:33 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1282 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:34.469159 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:34.469756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:34.477140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:34.477579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:34.478337 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:34.478763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:34.644157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:34.653003 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:34.654500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:34.656157 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-23521fd0-c6e2-4173-b53d-35b06cb5a084 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1342 microversion: 2.20 time: 0.191301 Nov 24 18:26:34.666889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 875/1752] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:34 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1342 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:35.675839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:35.676548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:35.683557 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:35.684035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:35.684786 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:35.685210 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:35.907960 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:35.916479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:35.917951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:35.919009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-59536025-db84-4251-95b5-c9eeee591ecf tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.248482 Nov 24 18:26:35.919554 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 878/1753] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:35 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:36.559562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-bf35b17f-56c5-4261-a6a1-b55602500209 req-e35f6762-0987-4b69-a28c-9242361f4f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:36.561145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:36.561145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:26:36.579777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-bf35b17f-56c5-4261-a6a1-b55602500209 req-e35f6762-0987-4b69-a28c-9242361f4f09 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:36.580333 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-bf35b17f-56c5-4261-a6a1-b55602500209 req-e35f6762-0987-4b69-a28c-9242361f4f09 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:36.599583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-bf35b17f-56c5-4261-a6a1-b55602500209 req-e35f6762-0987-4b69-a28c-9242361f4f09 service nova] Creating event network-changed:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:26:36.604514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-bf35b17f-56c5-4261-a6a1-b55602500209 req-e35f6762-0987-4b69-a28c-9242361f4f09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048661 Nov 24 18:26:36.605104 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 876/1754] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:36.938425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:36.939228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:36.946495 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:36.946927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:36.947701 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:36.948122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:37.150472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:37.160072 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:37.161533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:37.162587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6c55f94e-0208-422b-bd2e-ec9bd01bc250 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.228223 Nov 24 18:26:37.163161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 879/1755] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:36 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:38.181943 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:38.182667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:38.190617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:38.191061 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:38.191952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:38.192385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:38.403838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:38.412655 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:38.414141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:38.415201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2da65739-a621-4fba-b6a3-280f8a9bf09b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.237366 Nov 24 18:26:38.415777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 877/1756] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:38 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:39.433404 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:39.434008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:39.442441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:39.442885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:39.443677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:39.444116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:39.644890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:39.653364 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:39.654868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:39.656443 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-22c65a21-d9e4-4c1f-9404-1b4028cd119f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.226807 Nov 24 18:26:39.656987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 880/1757] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:39 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:40.674918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:40.675817 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:40.682982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:40.683427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:40.684218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:40.684654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:40.900373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:40.909669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:40.911152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:40.912244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a5002a1b-8b69-44ab-9415-8c4fa32711e2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.241731 Nov 24 18:26:40.912794 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 878/1758] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:40 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:26:41.930477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:41.931074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:41.938526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:41.938962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:41.939919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:41.940344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:42.063267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-85af3af5-765c-4e21-a64a-2a2dde828160 req-2c8d7d18-f59c-48ca-b117-61dfce4a7693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "name": "network-vif-plugged", "status": "completed", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:42.065683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:42.065683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:26:42.073864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-85af3af5-765c-4e21-a64a-2a2dde828160 req-2c8d7d18-f59c-48ca-b117-61dfce4a7693 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:42.074308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-85af3af5-765c-4e21-a64a-2a2dde828160 req-2c8d7d18-f59c-48ca-b117-61dfce4a7693 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:42.091090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-85af3af5-765c-4e21-a64a-2a2dde828160 req-2c8d7d18-f59c-48ca-b117-61dfce4a7693 service nova] Creating event network-vif-plugged:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:26:42.096600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-85af3af5-765c-4e21-a64a-2a2dde828160 req-2c8d7d18-f59c-48ca-b117-61dfce4a7693 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092245 Nov 24 18:26:42.097608 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 879/1759] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:26:42.149467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:42.158858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:42.160458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:42.161566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-58799442-2b49-4bfd-9cfb-a48b2298e04d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.234809 Nov 24 18:26:42.162310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 881/1760] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:41 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:43.183514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:43.184733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:43.195137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:43.195582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:43.196402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:43.196840 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:43.393898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:43.402543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:43.404132 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:43.405747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-755e9ee8-4989-429f-94ef-b7ae362ce56b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1408 microversion: 2.20 time: 0.228655 Nov 24 18:26:43.406326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 880/1761] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:43 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:44.423641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:44.424247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:44.431869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:44.432308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:44.433057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:44.433486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:44.630049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:44.638410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:44.640325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:26:44.641415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8b44e97a-abf0-4a8d-9506-a23e99f29e56 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1599 microversion: 2.20 time: 0.221575 Nov 24 18:26:44.641952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 882/1762] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:26:44 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:26:44.658986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:26:44.659478 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:44.666787 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:44.667238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:44.668046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:44.668479 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:44.818020 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b406b71f-3e4b-4e57-9bd4-51e8ea8e399d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163201 Nov 24 18:26:44.818602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 881/1763] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 24 18:26:44 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:26:46.448032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-38d1ed02-226e-469f-9ff5-58204a0c702f req-6c7e9b1c-4adb-46d6-a64e-d92e8964fd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:46.449594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:26:46.449594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:26:46.450060 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:46.451027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:46.459090 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:46.459313 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-38d1ed02-226e-469f-9ff5-58204a0c702f req-6c7e9b1c-4adb-46d6-a64e-d92e8964fd82 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:46.459538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:46.459830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-38d1ed02-226e-469f-9ff5-58204a0c702f req-6c7e9b1c-4adb-46d6-a64e-d92e8964fd82 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:46.460338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:46.460763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:46.478686 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-38d1ed02-226e-469f-9ff5-58204a0c702f req-6c7e9b1c-4adb-46d6-a64e-d92e8964fd82 service nova] Creating event network-changed:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:26:46.484201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-38d1ed02-226e-469f-9ff5-58204a0c702f req-6c7e9b1c-4adb-46d6-a64e-d92e8964fd82 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039576 Nov 24 18:26:46.485542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 882/1764] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:26:46.557141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4f08bb71-92a2-49e8-9046-0b2a9bb13cc5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.115305 Nov 24 18:26:46.560774 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 883/1765] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:46 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:47.570280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:47.571833 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:47.582645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:47.583117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:47.583907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:47.584344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:47.698043 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5bce5f3d-9342-4024-848c-d38ce9ca77ba tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.133133 Nov 24 18:26:47.698682 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 883/1766] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:47 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:48.709615 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:48.710547 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:48.718633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:48.719067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:48.719850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:48.720278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:48.812212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a1a10509-0b90-4a63-b45a-3ecd13fc1108 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.106644 Nov 24 18:26:48.812843 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 884/1767] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:48 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:26:49.822987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:49.824007 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:49.832423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:49.832873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:49.833637 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:49.834071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:49.947218 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c0fcb62c-cf34-4032-b8b0-2ba3c1c5748c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.128177 Nov 24 18:26:49.947868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 884/1768] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:49 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:50.959452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:50.960463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:50.968762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:50.969193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:50.969938 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:50.970358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:51.071027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fda87d72-40ff-421d-a58b-ca880f175f66 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.116145 Nov 24 18:26:51.071661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 885/1769] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:50 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:52.083842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:52.084824 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:52.093354 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:52.093789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:52.094540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:52.094966 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:52.191178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-18bd2b04-cbb0-40c2-b932-d77a2ab3aa67 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.111494 Nov 24 18:26:52.191810 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 885/1770] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:52 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:53.203005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:53.203936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:53.211708 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:53.212150 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:53.212899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:53.213325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:53.306519 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-35993973-b608-4cc0-9047-25b275f7161b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.107821 Nov 24 18:26:53.307145 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 886/1771] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:53 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:54.318589 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:54.319573 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:54.328032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:54.328473 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:54.329250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:54.329677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:54.426601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4cb0a756-377c-438c-bbc9-35be7aa458df tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.111974 Nov 24 18:26:54.427220 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 886/1772] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:54 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:55.438678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:55.439702 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:55.447508 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:55.447987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:55.448742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:55.449172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:55.543885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f7426195-cfa0-445d-b862-703a46926943 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 14 microversion: 2.20 time: 0.109911 Nov 24 18:26:55.544475 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 887/1773] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:55 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:26:56.555583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:56.556583 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:56.564944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:56.565390 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:56.566174 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:56.566638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:56.697987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b9d53813-3ffd-4abb-907a-8c89986f4f36 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 12331 microversion: 2.20 time: 0.146222 Nov 24 18:26:56.698526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 887/1774] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:56 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 12331 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:26:57.710149 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:57.711085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:57.719909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:57.720349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:57.721095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:57.721520 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:57.836410 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ec90b41e-df1c-4e9f-a895-556aef7d31f9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 18449 microversion: 2.20 time: 0.130286 Nov 24 18:26:57.840018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 888/1775] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:57 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 18449 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:26:58.848336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:58.849346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:58.857066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:58.858011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:58.858770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:58.859201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:58.966280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fa4fc208-12ca-474f-b763-4409c5caa6b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 19342 microversion: 2.20 time: 0.121941 Nov 24 18:26:58.966912 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 888/1776] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:58 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 19342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:26:59.978331 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:26:59.979390 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:26:59.989264 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:59.989365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:26:59.990073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:26:59.990500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:00.097730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f0217ece-eded-41b9-8879-2465de984f6b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 21840 microversion: 2.20 time: 0.123332 Nov 24 18:27:00.098360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 889/1777] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:26:59 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 21840 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:01.109604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:01.111579 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:01.119843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:01.120296 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:01.121067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:01.121502 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:01.238368 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8c0c217c-46e6-43d1-8ef9-304580ba73b7 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 23235 microversion: 2.20 time: 0.132791 Nov 24 18:27:01.238984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 889/1778] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:01 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 23235 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:02.250240 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:02.251257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:02.259042 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:02.259487 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:02.260270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:02.260701 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:02.373628 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4bd721f3-5c31-4ca4-9366-6dcdad7173aa tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 24679 microversion: 2.20 time: 0.127039 Nov 24 18:27:02.374266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 890/1779] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:02 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 24679 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:03.385771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:03.386795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:03.394829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:03.395280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:03.396068 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:03.396510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:03.508496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8debb04e-f593-45b8-b8d7-b0ef9e530da9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 26222 microversion: 2.20 time: 0.126714 Nov 24 18:27:03.509146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 890/1780] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:03 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 26222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:04.525080 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:04.526066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:04.534007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:04.534447 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:04.535203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:04.535648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:04.661880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-de7eafc5-89f8-4c23-9c6f-45591995e49f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 27369 microversion: 2.20 time: 0.143437 Nov 24 18:27:04.662465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 891/1781] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:04 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 27369 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:05.674377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:05.675677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:05.683684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:05.684139 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:05.684907 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:05.685446 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:05.800789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6cb3fccd-b814-4c9c-a9f3-1618f5a26cee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 27914 microversion: 2.20 time: 0.130422 Nov 24 18:27:05.801659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 891/1782] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:05 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 27914 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:06.812561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:06.813535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:06.821261 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:06.821696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:06.822440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:06.822867 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:06.937756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2daa5163-d684-4a9e-8bd9-96d3fa590a8b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28227 microversion: 2.20 time: 0.129179 Nov 24 18:27:06.938362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 892/1783] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:06 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28227 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:07.949838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:07.950825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:07.958685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:07.959129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:07.959930 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:07.960356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:08.068373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7bfc9040-56ae-4af9-936d-51448f0a4e8a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28227 microversion: 2.20 time: 0.122381 Nov 24 18:27:08.069046 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 892/1784] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:07 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28227 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:09.080883 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:09.081896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:09.089696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:09.090146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:09.090915 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:09.091351 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:09.201885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-098dfe30-b5b4-43d1-8a71-2c115f8c3ccc tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28372 microversion: 2.20 time: 0.125013 Nov 24 18:27:09.202489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 893/1785] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:09 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28372 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:10.213398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:10.214287 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:10.222865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:10.223303 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:10.224086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:10.224513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:10.348256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-44a2e2fd-beb7-40f9-82aa-692d399741ee tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28641 microversion: 2.20 time: 0.138787 Nov 24 18:27:10.349210 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 893/1786] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:10 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28641 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 18:27:11.360892 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:11.361916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:11.369671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:11.370108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:11.370855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:11.371320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:11.492874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0e01d2f9-ce7e-46e2-b458-408ffc5efb03 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28686 microversion: 2.20 time: 0.136669 Nov 24 18:27:11.493531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 894/1787] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:11 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28686 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:12.505523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:12.506507 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:12.514398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:12.514845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:12.515617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:12.516057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:12.615755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6c952293-a870-4cf4-b4a8-9de2bd1387d3 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28686 microversion: 2.20 time: 0.114140 Nov 24 18:27:12.616373 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 894/1788] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:12 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28686 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:13.627436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:13.628440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:13.636155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:13.636594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:13.637334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:13.637753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:13.736440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d34fe787-8d43-4b8a-b357-5f6d66737e1c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28686 microversion: 2.20 time: 0.113468 Nov 24 18:27:13.736966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 895/1789] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:13 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28686 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:14.749617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:14.750510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:14.758238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:14.758677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:14.759423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:14.759868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:14.858800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2b2d9e19-c412-469e-ba4d-9fa50863c85c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 28686 microversion: 2.20 time: 0.114297 Nov 24 18:27:14.860312 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 895/1790] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:14 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 28686 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:15.871089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:15.872152 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:15.880113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:15.880548 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:15.881376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:15.881799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:16.000017 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-93fa8ba2-a930-4857-8f62-2460511ae781 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 30673 microversion: 2.20 time: 0.132797 Nov 24 18:27:16.000632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 896/1791] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:15 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 30673 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:17.012488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:17.013555 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:17.021457 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:17.021909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:17.022679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:17.023120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:17.128998 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3547cfa2-5209-4500-963d-dabcc0ce23c8 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 32706 microversion: 2.20 time: 0.119962 Nov 24 18:27:17.129628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 896/1792] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:17 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 32706 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:18.141099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:18.142107 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:18.150750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:18.151191 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:18.152004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:18.152435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:18.265971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9a6dc855-1190-445c-a660-0337f6926fe4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 33577 microversion: 2.20 time: 0.128834 Nov 24 18:27:18.266580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 897/1793] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:18 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 33577 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:19.279375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:19.280289 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:19.288053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:19.288501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:19.289257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:19.289712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:19.400334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c1b9bac8-1351-41e4-9654-a64c9ee14972 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 34761 microversion: 2.20 time: 0.125528 Nov 24 18:27:19.401240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 897/1794] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:19 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 34761 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:20.413838 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:20.415153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:20.427538 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:20.428006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:20.428771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:20.429192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:20.685966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0790ce40-51bc-4e26-9d44-b6ec84f1775f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 35993 microversion: 2.20 time: 0.276896 Nov 24 18:27:20.686678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 898/1795] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:20 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 35993 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:21.698385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:21.699314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:21.707091 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:21.707535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:21.708324 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:21.708756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:21.823127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f486d85b-7044-43b7-8663-1f804b4bf3e5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 37629 microversion: 2.20 time: 0.128729 Nov 24 18:27:21.824058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 898/1796] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:21 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 37629 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:22.835658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:22.836644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:22.844396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:22.844836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:22.845589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:22.846018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:22.952147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-72bb7af8-4ed4-444a-a809-7c2ff97b27b2 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 38243 microversion: 2.20 time: 0.120219 Nov 24 18:27:22.953004 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 899/1797] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:22 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 38243 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:23.964485 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:23.965641 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:23.973525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:23.973973 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:23.974740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:23.975172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:24.081852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7a3d7cba-f6ff-407a-b98a-72b0388bebad tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 38243 microversion: 2.20 time: 0.120519 Nov 24 18:27:24.081852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 899/1798] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:23 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 38243 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:25.094433 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:25.095426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:25.103169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:25.103631 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:25.104408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:25.104842 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:25.210158 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f9b1546f-5565-4d1d-a23f-a98a0a04d5be tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 38243 microversion: 2.20 time: 0.120678 Nov 24 18:27:25.210816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 900/1799] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:25 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 38243 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:26.225171 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:26.226288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:26.236298 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:26.237143 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:26.238148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:26.238593 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:26.353836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e0325bde-c0cd-44fd-8e4b-21d9f9b46035 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 200 len: 38386 microversion: 2.20 time: 0.133379 Nov 24 18:27:26.354514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 900/1800] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:26 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 38386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:27:26.365602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:26.366174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:26.374194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:26.374639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:26.375403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:26.375859 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:26.432649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d4d629d1-b974-46bb-bf3d-c99721f0b7ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/ips" status: 200 len: 151 microversion: 2.20 time: 0.071036 Nov 24 18:27:26.433108 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 901/1801] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Nov 24 18:27:26 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:27:28.639852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:28.640654 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:28.648388 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:28.648832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:28.649578 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:28.650002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:28.708237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lazy-loading 'flavor' on Instance uuid f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:27:29.027494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c7943205-5582-477a-8af3-553d4c71c13a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.391922 Nov 24 18:27:29.030315 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 901/1802] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:28 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:27:29.037286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:29.037895 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:29.045647 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:29.046162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:29.047029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:29.047454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:29.245832 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:29.255578 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:29.257089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:29.258194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-a7a05e0a-c9dd-4340-a962-cf6282846928 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.224868 Nov 24 18:27:29.258730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 902/1803] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:29 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:30.278341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:30.279035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:30.287113 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:30.287552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:30.288344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:30.288772 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:30.636211 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:30.644800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:30.646275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:30.647382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-78183708-afc7-4f41-8320-b63f14541aa9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.373703 Nov 24 18:27:30.647985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 902/1804] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:30 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:31.666333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:31.667056 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:31.675482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:31.675948 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:31.676710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:31.677140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:31.886254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:31.894871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:31.896407 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:31.897505 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-dc7200e9-2b58-4fb4-8b9c-b898b735d0b1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.234854 Nov 24 18:27:31.898033 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 903/1805] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:31 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:32.558735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:27:32.558946 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:27:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:27:32.916101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:32.916740 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:32.924526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:32.924970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:32.925982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:32.926414 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:33.117753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:33.126780 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:33.128299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:33.129404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-79d985b1-3d59-48c7-9333-2ef906b77297 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.216983 Nov 24 18:27:33.129942 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 903/1806] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:32 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:34.148376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:34.148913 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:34.156875 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:34.157307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:34.158061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:34.158486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:34.352761 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:34.361622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:34.363089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:34.364275 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-440e6a3d-29d7-4a0c-82a3-4906451c405f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.219746 Nov 24 18:27:34.364812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 904/1807] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:34 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:35.383308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:35.383947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:35.391924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:35.392367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:35.393150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:35.393572 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:35.590404 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:35.599897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:35.601376 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:35.602487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3ab66cce-a221-4c7e-8d43-54e25d82a48b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.222873 Nov 24 18:27:35.603023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 904/1808] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:35 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:36.620902 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:36.621492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:36.629541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:36.629977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:36.630717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:36.631139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:36.827973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:36.836531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:36.838008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:36.839111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3eb881c8-2a51-477b-9a34-c5d19a72ec32 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.221899 Nov 24 18:27:36.839662 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 905/1809] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:36 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:37.857854 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:37.859421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:37.867055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:37.867493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:37.868271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:37.868695 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:38.066436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:38.075267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:38.076781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:38.078658 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2ef9a0a5-483f-4a9b-9a83-7864a027cc4a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.224538 Nov 24 18:27:38.079399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 905/1810] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:37 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:39.097904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:39.098499 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:39.105682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:39.106122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:39.106871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:39.107296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:39.302792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:39.312257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:39.313871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:39.315262 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c38d8320-326d-44c0-b74a-f125f77ab069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.221141 Nov 24 18:27:39.316129 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 906/1811] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:39 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:40.336743 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:40.338513 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:40.345784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:40.346230 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:40.347028 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:40.347453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:40.558181 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:40.568141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:40.569648 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:40.570756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3c8be8dd-c347-4b81-8496-71476387d4d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1745 microversion: 2.20 time: 0.238176 Nov 24 18:27:40.571294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 906/1812] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:40 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1745 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:41.589534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:41.590175 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:41.599283 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:41.599763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:41.600564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:41.600993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:41.820339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:41.830659 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:41.832540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:41.833666 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b55bd7ce-b284-4bfd-86d7-d7f4e92659fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.247966 Nov 24 18:27:41.834202 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 907/1813] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:41 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:42.514605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-464d99f1-b82d-41a2-8509-61f3038e3db2 req-6e8583c9-0d2d-4bcf-a4ae-b4df3cad4b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "name": "network-vif-plugged", "status": "completed", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:42.520535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:27:42.520535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:27:42.549254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-464d99f1-b82d-41a2-8509-61f3038e3db2 req-6e8583c9-0d2d-4bcf-a4ae-b4df3cad4b02 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:42.550071 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-464d99f1-b82d-41a2-8509-61f3038e3db2 req-6e8583c9-0d2d-4bcf-a4ae-b4df3cad4b02 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:42.577280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-464d99f1-b82d-41a2-8509-61f3038e3db2 req-6e8583c9-0d2d-4bcf-a4ae-b4df3cad4b02 service nova] Creating event network-vif-plugged:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:27:42.584691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-464d99f1-b82d-41a2-8509-61f3038e3db2 req-6e8583c9-0d2d-4bcf-a4ae-b4df3cad4b02 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077401 Nov 24 18:27:42.586121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 907/1814] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:27:42.853147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:42.854441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:42.862493 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:42.863193 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:42.864151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:42.864767 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:43.121664 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:43.137317 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:43.138797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:43.141165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cfcc4974-648a-457a-a950-59d11790d3b5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.291502 Nov 24 18:27:43.142147 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 908/1815] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:42 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:44.161444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:44.162136 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:44.169821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:44.170271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:44.171476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:44.171948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:44.399251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:44.412227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:44.413723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:44.415815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d6872226-f220-4ab8-87c8-9de140992adb tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.257798 Nov 24 18:27:44.415815 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 908/1816] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:44 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:45.435365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:45.436608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:45.448998 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:45.449799 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:45.450814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:45.451444 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:45.698642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:45.708783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:45.710248 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:45.711354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37340a25-c376-4b7e-86a4-312fb66cfcfe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.280135 Nov 24 18:27:45.712098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 909/1817] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:45 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:46.730241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:46.730746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:46.739251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:46.739728 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:46.740489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:46.740939 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:46.955063 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:46.963681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:46.965178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:46.966284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-78946b75-fb22-40c6-8272-00c5ff32f61a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.239876 Nov 24 18:27:46.966827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 909/1818] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:46 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:47.987421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:47.989956 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:48.000394 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:48.001180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:48.002815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:48.003330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:48.243378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:48.253285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:48.254754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:48.256172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8c6627aa-7af2-4aa5-a04a-3aeb7a38a8c4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.272429 Nov 24 18:27:48.257014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 910/1819] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:47 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:49.274512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:49.275099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:49.283193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:49.283804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:49.284800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:49.285588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:49.515427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:49.524773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:49.526268 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:49.527411 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6a2f0bbd-ee2d-4865-8bb6-144d2ed08ff4 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.257050 Nov 24 18:27:49.528260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 910/1820] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:49 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:50.547228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:50.547853 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:50.555290 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:50.555764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:50.556513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:50.556932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:50.750700 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:50.759161 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:50.760658 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:50.761757 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-87455aca-ecc1-46d4-a3b3-cc9e80825fe6 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1740 microversion: 2.20 time: 0.219522 Nov 24 18:27:50.762300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 911/1821] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:50 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:51.781125 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:51.781758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:51.789529 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:51.789970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:51.790735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:51.791165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:51.989402 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:51.997927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:52.000052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:52.001135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0224d2a1-c60e-48a4-8898-cf6ed5a6a854 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1722 microversion: 2.20 time: 0.224641 Nov 24 18:27:52.001679 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 911/1822] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:51 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:27:53.019648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:53.020253 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:53.027431 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:53.027898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:53.028657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:53.029082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:53.315688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:53.324021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:53.325480 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:53.327062 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6a38271d-4331-4a2d-82e1-aacf49100ce5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1722 microversion: 2.20 time: 0.310833 Nov 24 18:27:53.327771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 912/1823] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:53 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:54.344976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:54.345585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:54.352674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:54.353131 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:54.353904 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:54.354340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:54.402678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-976c5bbb-8dc8-47ea-b6a7-327b45d65f54 req-187b6196-0bc3-4c04-b249-3c0fe74a0f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "name": "network-vif-unplugged", "status": "completed", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:54.406232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:27:54.406232 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:27:54.419227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-976c5bbb-8dc8-47ea-b6a7-327b45d65f54 req-187b6196-0bc3-4c04-b249-3c0fe74a0f6d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:54.420122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-976c5bbb-8dc8-47ea-b6a7-327b45d65f54 req-187b6196-0bc3-4c04-b249-3c0fe74a0f6d service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:54.448748 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.compute.server_external_events [req-976c5bbb-8dc8-47ea-b6a7-327b45d65f54 req-187b6196-0bc3-4c04-b249-3c0fe74a0f6d service nova] Unable to find a host for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe. Dropping event network-vif-unplugged {{(pid=100949) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 18:27:54.449911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-976c5bbb-8dc8-47ea-b6a7-327b45d65f54 req-187b6196-0bc3-4c04-b249-3c0fe74a0f6d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051318 Nov 24 18:27:54.450818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 913/1824] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:27:54 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 24 18:27:54.641938 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:54.650377 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:54.651888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:54.653003 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7799ae3c-2f48-4562-be7d-2b7f4ac624fe tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1665 microversion: 2.20 time: 0.312013 Nov 24 18:27:54.653548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 912/1825] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:54 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1665 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:54.670964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1e95321-32b1-443d-8f8d-92cb68713e04"}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:54.672192 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:54.679565 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:54.680030 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:54.680776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:54.681201 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:55.098696 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8d4b5105-37c1-4d5f-be39-53b78d516738 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.431951 Nov 24 18:27:55.099204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 914/1826] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Nov 24 18:27:54 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments => generated 188 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 18:27:55.299539 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:55.300054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:55.307382 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:55.307852 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:55.308614 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:55.309044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:55.745841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-02dbcbbe-c60b-4437-84af-e68cbd8c5a01 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments/e1e95321-32b1-443d-8f8d-92cb68713e04" status: 202 len: 0 microversion: 2.20 time: 0.450567 Nov 24 18:27:55.746501 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 913/1827] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Nov 24 18:27:55 2021] DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments/e1e95321-32b1-443d-8f8d-92cb68713e04 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:27:55.842019 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:27:55.843166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:55.850959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:55.851401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:55.852196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:55.852630 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:55.996452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-97d45d83-5085-4fd3-aecc-47b02ef18057 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action" status: 202 len: 0 microversion: 2.20 time: 0.158154 Nov 24 18:27:55.996963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 915/1828] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Nov 24 18:27:55 2021] POST /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:27:56.005279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:56.005896 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:56.012983 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:56.013506 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:56.014899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:56.015383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:56.219258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:56.227994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:56.229476 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:56.230604 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0d3a89e9-50c0-46d9-b95d-0f122e885d4c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1673 microversion: 2.20 time: 0.229029 Nov 24 18:27:56.231140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 914/1829] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:56 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1673 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:57.250747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:57.251269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:57.258365 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:57.258824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:57.259575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:57.260018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:57.459375 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:57.467858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:57.469347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:57.470460 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-62df7704-6627-487e-a177-c3250ed34e41 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.224594 Nov 24 18:27:57.481474 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 916/1830] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:57 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:58.490026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:58.490632 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:58.500059 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:58.500568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:58.501360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:58.501784 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:58.738481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:58.747552 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:58.750262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:58.751722 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4d8e6d5c-f811-43ff-bda8-b4139a2d10d5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.265488 Nov 24 18:27:58.763242 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 915/1831] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:58 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:27:59.770604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:27:59.771212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:27:59.779435 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:59.780133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:59.781116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:27:59.781775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:27:59.984607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:59.993151 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:59.994636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:27:59.995779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c2b66ce5-b889-4bef-ad46-a8bd57951981 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.229146 Nov 24 18:27:59.996333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 917/1832] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:27:59 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:01.014332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:01.014928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:01.022796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:01.023236 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:01.024025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:01.024454 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:01.230214 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:01.239360 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:01.240873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:01.241996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cdf21f77-c322-41fb-a70a-ed1aa7ed3ea0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.231363 Nov 24 18:28:01.257837 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 916/1833] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:01 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:02.260650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:02.261280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:02.270694 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:02.271185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:02.272215 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:02.272648 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:02.488366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:02.498135 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:02.499650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:02.501339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8bc1f422-4c2b-4ab4-a05c-210b22ab610c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.244397 Nov 24 18:28:02.501886 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 918/1834] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:02 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:03.520363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:03.520994 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:03.528474 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:03.528915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:03.529677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:03.530102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:03.747482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:03.757803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:03.759349 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:03.760497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ee5a05b8-bbb7-4d1f-8293-df563cce5dd0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.244963 Nov 24 18:28:03.761038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 917/1835] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:03 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:04.779186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:04.779845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:04.788017 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:04.788536 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:04.789439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:04.789868 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:05.000698 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:05.009606 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:05.011100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:05.012251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8e54541d-af61-4164-9fcf-6e20eccafa8d tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.236826 Nov 24 18:28:05.012801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 919/1836] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:04 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:06.030851 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:06.031704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:06.040753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:06.041290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:06.042328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:06.042845 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:06.252409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:06.261355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:06.262855 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:06.264015 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bd596c1f-97f2-4934-939b-7c04995783a9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.237485 Nov 24 18:28:06.264564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 918/1837] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:06 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:07.283964 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:07.284806 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:07.292562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:07.293082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:07.293898 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:07.294325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:07.505568 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:07.514626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:07.516136 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:07.517887 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c95469a9-e8d0-48ca-8a91-9fcf001aeea9 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.238033 Nov 24 18:28:07.518561 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 920/1838] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:07 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:08.473044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:08.473628 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:08.481232 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.481696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.482469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.482903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.536137 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:08.537649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:08.542302 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lazy-loading 'flavor' on Instance uuid 736ce395-1f9b-46b2-8890-8cc53afa8729 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:28:08.545644 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.546428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.547796 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.548717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.724250 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-37380965-c264-484e-a0cd-369185e061b4 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "POST /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729/action" status: 202 len: 0 microversion: 2.1 time: 0.255498 Nov 24 18:28:08.725023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 919/1839] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:28:08 2021] POST /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:28:08.733025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:08.733963 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:08.743200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.743732 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.744465 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:08.744889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:08.808896 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:08.818626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:08.820153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:08.821280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-78572022-87ad-419a-b1d4-216b3053642a tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.288897 Nov 24 18:28:08.821825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 921/1840] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:08 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:28:08.952112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:08.960568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a4da5ead-9dc1-475f-8ec6-b74e4f443df2 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.231378 Nov 24 18:28:08.961133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 920/1841] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:08 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:09.839207 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:09.839818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:09.847650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:09.848184 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:09.849071 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:09.849594 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:09.978423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:09.979054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:09.987245 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:09.987723 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:09.988489 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:09.988914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:10.043018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:10.052839 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:10.054320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:10.055436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-821e0c74-6c10-48a8-b688-472ec1507ec1 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.219928 Nov 24 18:28:10.064997 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 922/1842] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:09 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:10.189275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:10.197391 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-90426115-4308-462c-bc95-e75d860c3071 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.222690 Nov 24 18:28:10.197953 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 921/1843] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:09 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:11.082524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:11.083188 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:11.090544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:11.090999 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:11.091776 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:11.092203 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:11.214764 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:11.215456 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:11.223760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:11.224297 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:11.225147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:11.225698 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:11.296581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:11.306441 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:11.308749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:11.309858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-14e24fb9-b18e-4a57-ad4a-ca7756bce069 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.231035 Nov 24 18:28:11.310424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 923/1844] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:11 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:11.455171 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:11.463189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-2de2fbca-1e96-4021-8298-3c7774bf760b tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.252139 Nov 24 18:28:11.463774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 922/1845] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:11 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:12.329089 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:12.330235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:12.338608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:12.339313 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:12.340110 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:12.340539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:12.479984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:12.481255 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:12.490813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:12.491270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:12.492640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:12.493221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:12.551781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:12.561116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:12.562589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:12.563962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fa25f9ac-54a1-4a5f-8863-edd5bd6eee07 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.238368 Nov 24 18:28:12.564677 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 924/1846] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:12 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:12.703895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:12.714582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-43962d65-8c95-4503-9830-a940029f30fb tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.238354 Nov 24 18:28:12.715176 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 923/1847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:12 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:13.582486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:13.583116 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:13.590270 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:13.590730 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:13.591500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:13.591936 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:13.731805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:13.732347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:13.740367 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:13.740811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:13.741592 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:13.742026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:13.817738 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:13.826379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:13.827910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:13.829035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7356bdd6-190f-474a-b8ee-014e89dc2a47 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.250454 Nov 24 18:28:13.829592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 925/1848] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:13 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:13.941215 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:13.949319 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6ef56f9c-a473-4c6c-819b-dcf2a4cf6979 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.221401 Nov 24 18:28:13.949873 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 924/1849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:13 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:14.553268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-f4045109-bf16-4d0c-8c67-047c3a14d19a req-ebe7d857-315b-4dfc-b920-906691c8ab55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "name": "network-vif-plugged", "status": "completed", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:14.555281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:28:14.555281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:28:14.564518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-f4045109-bf16-4d0c-8c67-047c3a14d19a req-ebe7d857-315b-4dfc-b920-906691c8ab55 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:14.564957 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-f4045109-bf16-4d0c-8c67-047c3a14d19a req-ebe7d857-315b-4dfc-b920-906691c8ab55 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:14.581276 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-f4045109-bf16-4d0c-8c67-047c3a14d19a req-ebe7d857-315b-4dfc-b920-906691c8ab55 service nova] Creating event network-vif-plugged:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:28:14.586046 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-f4045109-bf16-4d0c-8c67-047c3a14d19a req-ebe7d857-315b-4dfc-b920-906691c8ab55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036567 Nov 24 18:28:14.586924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 926/1850] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:28:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:14.847270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:14.847895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:14.854982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:14.855427 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:14.856228 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:14.856685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:14.967457 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:14.968239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:14.975624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:14.976093 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:14.976860 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:14.977292 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:15.058836 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:15.069263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:15.070826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:15.072076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bda4a9b5-f88b-40f9-afe8-b5ca7f02b491 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.228951 Nov 24 18:28:15.072696 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 925/1851] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:14 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:15.174263 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:15.182530 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b4ccd735-d535-4f18-9e68-21d3b52307ea tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.219264 Nov 24 18:28:15.183086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 927/1852] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:14 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:16.089677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:16.090288 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:16.098107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:16.098639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:16.099434 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:16.099897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:16.199518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:16.200162 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:16.209791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:16.210227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:16.211020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:16.211439 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:16.315633 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:16.325301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:16.327396 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:16.328624 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bc0a4d2c-ec5a-4186-80ab-62b0d5e4f0ef tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1731 microversion: 2.20 time: 0.242426 Nov 24 18:28:16.329895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 926/1853] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:16 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:16.442268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:16.450852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-498615e7-d310-4369-9b39-5cd423f2d068 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.254978 Nov 24 18:28:16.451385 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 928/1854] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:16 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:17.349362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:17.349875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:17.357150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:17.357588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:17.358341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:17.358796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:17.468685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:17.470491 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:17.477810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:17.478339 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:17.479185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:17.479725 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:17.558531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:17.567260 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:17.568783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:17.569903 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-8f3477ca-260d-41d8-b36e-3adac37252d0 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1718 microversion: 2.20 time: 0.226037 Nov 24 18:28:17.570462 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 927/1855] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:17 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1718 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:17.680402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:17.689104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-37b34348-866a-4bac-ab6f-f875dc04ede3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.223848 Nov 24 18:28:17.689841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 929/1856] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:17 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:18.706076 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:18.706782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:18.714712 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:18.715090 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:18.715864 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:18.716294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:18.921835 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:18.931276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4012dab8-cb08-4ca4-88e4-d5cc51d030e5 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.228793 Nov 24 18:28:18.931898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 928/1857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:18 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:19.947155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:19.947801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:19.954850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:19.955286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:19.956104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:19.956534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:20.149523 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:20.157421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8ee90abd-7662-4f73-bf59-6fad57eb1d8e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.213908 Nov 24 18:28:20.157966 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 930/1858] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:19 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:21.176419 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:21.177030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:21.184235 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:21.184675 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:21.185483 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:21.185913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:21.518455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:21.526642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9386bb68-0952-4f3c-8848-ab56b9f43c3f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.354720 Nov 24 18:28:21.527202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 929/1859] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:21 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:22.543382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:22.544131 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:22.552139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:22.552576 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:22.553335 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:22.553760 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:22.753916 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:22.762155 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5bbd75bf-2de7-4210-9a61-2b6a9165d218 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.222521 Nov 24 18:28:22.762732 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 931/1860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:22 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:23.210684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:23.211187 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:23.218428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.218877 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.219676 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.220141 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.268601 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. Nov 24 18:28:23.269771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:23.270668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b8604c5d-fd6f-4d13-a6e9-df961f0f296b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 404 len: 111 microversion: 2.1 time: 0.064134 Nov 24 18:28:23.271441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 930/1861] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:28:23 2021] DELETE /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:23.279073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:23.279711 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: bdc1dcde-4d03-4fde-b034-be9d70cd2aa4] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:23.288024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.288470 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.289427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.290421 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.341021 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. Nov 24 18:28:23.341540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:23.342360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d96f3a3-13e1-4bd8-a497-d3fd637c703a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4" status: 404 len: 111 microversion: 2.1 time: 0.067032 Nov 24 18:28:23.342908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 932/1862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:23 2021] GET /compute/v2.1/servers/bdc1dcde-4d03-4fde-b034-be9d70cd2aa4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 18:28:23.778785 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:23.779392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:23.786849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.787299 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.788102 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:23.788535 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:23.992649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:24.000882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a9f28f67-2984-4c58-afb7-83d63e73d25c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.226070 Nov 24 18:28:24.001441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 931/1863] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:23 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:24.578626 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:24.579115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:24.586756 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:24.587195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:24.587981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:24.588408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:24.636251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. Nov 24 18:28:24.636827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:24.637632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c29247b0-47c2-4908-acc0-dff33cb8e24b tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 404 len: 111 microversion: 2.1 time: 0.062729 Nov 24 18:28:24.638166 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 933/1864] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:28:24 2021] DELETE /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:24.646459 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:24.647087 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] [instance: 38f00b1d-a746-4496-a338-1a6ca81f15c7] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:24.654200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:24.654746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:24.655510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:24.655972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:24.715445 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] HTTP exception thrown: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. Nov 24 18:28:24.715985 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] Returning 404 to user: Instance 38f00b1d-a746-4496-a338-1a6ca81f15c7 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:24.716800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ebe59d78-7fc8-4021-bea0-42291a09529a tempest-AttachVolumeTestJSON-853213452 tempest-AttachVolumeTestJSON-853213452-project] 10.222.0.64 "GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7" status: 404 len: 111 microversion: 2.1 time: 0.074589 Nov 24 18:28:24.717347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 932/1865] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:24 2021] GET /compute/v2.1/servers/38f00b1d-a746-4496-a338-1a6ca81f15c7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:25.018607 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:25.019224 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:25.027532 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.028005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:25.028784 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.029212 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:25.439533 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:25.448595 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5f38e112-331b-49cd-9188-e222558b0dae tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1509 microversion: 2.1 time: 0.433628 Nov 24 18:28:25.449342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 934/1866] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:25 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:25.464514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:25.465074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:25.473152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.473760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:25.474522 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.474951 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:25.620413 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d2dc72bb-33e8-4631-9d77-b1366b6a68fd tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "POST /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729/action" status: 202 len: 0 microversion: 2.1 time: 0.159396 Nov 24 18:28:25.623841 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 933/1867] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 24 18:28:25 2021] POST /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:28:25.631164 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:25.633122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:25.641195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.642256 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:25.643376 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:25.644025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:26.089604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:26.101086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-5ea68f1c-6ca3-460a-bfe2-560837ad6799 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1517 microversion: 2.1 time: 0.475482 Nov 24 18:28:26.101808 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 935/1868] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:25 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:26.529821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-7695423e-085b-4b48-b723-f0f5fa4baf5c req-af0fd929-7233-4470-a803-2bc0e39763d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "name": "network-vif-unplugged", "status": "completed", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:26.531673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:28:26.531673 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:28:26.545752 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7695423e-085b-4b48-b723-f0f5fa4baf5c req-af0fd929-7233-4470-a803-2bc0e39763d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:26.546524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7695423e-085b-4b48-b723-f0f5fa4baf5c req-af0fd929-7233-4470-a803-2bc0e39763d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:26.569346 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.compute.server_external_events [req-7695423e-085b-4b48-b723-f0f5fa4baf5c req-af0fd929-7233-4470-a803-2bc0e39763d7 service nova] Unable to find a host for instance 736ce395-1f9b-46b2-8890-8cc53afa8729. Dropping event network-vif-unplugged {{(pid=100948) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 18:28:26.570568 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-7695423e-085b-4b48-b723-f0f5fa4baf5c req-af0fd929-7233-4470-a803-2bc0e39763d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046825 Nov 24 18:28:26.571809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 934/1869] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:28:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 24 18:28:27.118622 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:27.120031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:27.130801 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:27.131308 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:27.132115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:27.132541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:27.505482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:27.513639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-179e8d25-5ae2-4291-bdc3-0e0caa555805 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1519 microversion: 2.1 time: 0.400034 Nov 24 18:28:27.514198 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 936/1870] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:27 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1519 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:28.532167 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:28.533422 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:28.544984 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:28.545960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:28.547539 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:28.548150 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:28.757713 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:28.766497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1cd98f0d-13d3-45da-960c-d532a8483f4f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.238461 Nov 24 18:28:28.767380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 935/1871] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:28 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:29.784243 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:29.790301 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:29.799346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:29.801733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:29.803959 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:29.804846 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:30.196908 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:30.208754 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d32bea89-6c8a-46a4-8887-535ebdcb9450 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.427880 Nov 24 18:28:30.209809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 937/1872] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:29 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:31.228358 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:31.228963 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:31.236192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:31.236493 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:31.237468 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:31.237890 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:31.538551 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:31.546694 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d860dff0-8de7-4f53-8771-bca3bc6ccf8d tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.321960 Nov 24 18:28:31.547257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 936/1873] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:31 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:32.564226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:32.564849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:32.572571 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:32.573007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:32.573753 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:32.574174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:32.775196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:32.783510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a6ceda6-4e28-4a97-9f37-a5876787819c tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.222907 Nov 24 18:28:32.784106 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 938/1874] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:32 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:33.802254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:33.802862 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:33.810029 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:33.810475 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:33.811227 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:33.811688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:34.011045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:34.019160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-49e44258-d014-498d-8127-73df7db000cf tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.221978 Nov 24 18:28:34.019763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 937/1875] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:33 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:34.042218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b04b4c31-67ce-4c4a-95fb-37a61ad22c0b tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10142f70>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:34.130950 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b04b4c31-67ce-4c4a-95fb-37a61ad22c0b tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/760fc05f-e6e8-46cb-bf68-aa70926e040b" status: 200 len: 351 microversion: 2.1 time: 0.092250 Nov 24 18:28:34.131518 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 939/1876] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 18:28:34 2021] GET /compute/v2.1/os-volumes/760fc05f-e6e8-46cb-bf68-aa70926e040b => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:35.036154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:35.036755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:35.044040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:35.044484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:35.045239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:35.045659 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:35.239152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:35.247185 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-185c0e2a-96e5-4eab-b572-5a11544ca4f3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.214824 Nov 24 18:28:35.247756 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 938/1877] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:35 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:35.618121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-86df907d-f879-4206-bd67-32cbf9a9f4bc tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b1005aa60>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:35.711078 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-86df907d-f879-4206-bd67-32cbf9a9f4bc tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f6bdf19a-7f7d-4cc2-8b5a-bd75c0682274" status: 200 len: 351 microversion: 2.1 time: 0.096420 Nov 24 18:28:35.711656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 940/1878] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 18:28:35 2021] GET /compute/v2.1/os-volumes/f6bdf19a-7f7d-4cc2-8b5a-bd75c0682274 => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:28:36.264615 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:36.265205 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:36.272731 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:36.273179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:36.273944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:36.274381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:36.479564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:36.489484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-fee89a2a-6480-4a25-beaa-c1a3b4da9062 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.228516 Nov 24 18:28:36.490058 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 939/1879] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:36 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:37.313531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0bceaf68-0abe-4848-a277-51a89c9e2383 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10b91280>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.402559 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0bceaf68-0abe-4848-a277-51a89c9e2383 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/d84a7e3b-b8c2-4d89-b1ba-5d383249673c" status: 200 len: 350 microversion: 2.1 time: 0.092638 Nov 24 18:28:37.403121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 941/1880] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes/d84a7e3b-b8c2-4d89-b1ba-5d383249673c => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:37.414072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d927969b-bcac-414b-8188-b853954a38b6 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10bb03a0>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.496597 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d927969b-bcac-414b-8188-b853954a38b6 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086122 Nov 24 18:28:37.497152 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 940/1881] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:37.506627 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.507234 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:37.509902 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c4a29753-7e58-4319-811b-62cf0170bca0 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10bb0670>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.514500 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:37.514942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:37.515724 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:37.516157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:37.592280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c4a29753-7e58-4319-811b-62cf0170bca0 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085750 Nov 24 18:28:37.592882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 941/1882] 10.222.0.64 () {58 vars in 1148 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:28:37.605572 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1bf2bf8d-476b-46b3-b203-746cdd11be74 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10042670>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.689226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1bf2bf8d-476b-46b3-b203-746cdd11be74 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086980 Nov 24 18:28:37.689846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 942/1883] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:28:37.705599 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6ee7c7b4-933b-4cab-bf05-5ea28fbe4513 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10042280>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.722174 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:37.731345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d69612db-293c-481b-8e2d-8f4745b654e3 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.229096 Nov 24 18:28:37.731935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 942/1884] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:37.786405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6ee7c7b4-933b-4cab-bf05-5ea28fbe4513 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087699 Nov 24 18:28:37.786974 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 943/1885] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:37.798251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8bdbb442-0e5e-42f9-813b-4f087c5e895d tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10b91a60>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:37.877977 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8bdbb442-0e5e-42f9-813b-4f087c5e895d tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083175 Nov 24 18:28:37.878682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 943/1886] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:37.890940 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d7eb792a-b816-42c6-9edc-ac288e82f511 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10ab6160>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:38.101200 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d7eb792a-b816-42c6-9edc-ac288e82f511 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.213948 Nov 24 18:28:38.101773 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 944/1887] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Nov 24 18:28:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:38.112815 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cd488319-4ee5-42ed-b5a8-669ef0061239 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10b91940>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:38.191069 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cd488319-4ee5-42ed-b5a8-669ef0061239 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.081589 Nov 24 18:28:38.191881 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 944/1888] 10.222.0.64 () {58 vars in 1187 bytes} [Wed Nov 24 18:28:38 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:38.202931 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-78742325-ec12-4c60-8037-c013e36a6477 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] Calling method '.version_select at 0x7f8b10bb0280>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:38.282848 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-78742325-ec12-4c60-8037-c013e36a6477 tempest-VolumesTestJSON-163566591 tempest-VolumesTestJSON-163566591-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083325 Nov 24 18:28:38.283455 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 945/1889] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Nov 24 18:28:38 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:38.650924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-c8723bd0-cdf5-4dd7-bd44-53e36a7bede6 req-f4e6c997-72d7-42e0-a8e9-9bba85d999d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "name": "network-vif-plugged", "status": "completed", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:38.652953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:28:38.652953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:28:38.661794 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-c8723bd0-cdf5-4dd7-bd44-53e36a7bede6 req-f4e6c997-72d7-42e0-a8e9-9bba85d999d5 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:38.662226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-c8723bd0-cdf5-4dd7-bd44-53e36a7bede6 req-f4e6c997-72d7-42e0-a8e9-9bba85d999d5 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:38.677989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-c8723bd0-cdf5-4dd7-bd44-53e36a7bede6 req-f4e6c997-72d7-42e0-a8e9-9bba85d999d5 service nova] Creating event network-vif-plugged:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:28:38.683260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-c8723bd0-cdf5-4dd7-bd44-53e36a7bede6 req-f4e6c997-72d7-42e0-a8e9-9bba85d999d5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Nov 24 18:28:38.684146 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 945/1890] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:28:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:38.749731 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:38.750341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:38.758721 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:38.759189 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:38.759986 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:38.760416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:39.006562 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:39.014720 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ec11058d-73d6-4f86-9532-51503c6eee31 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.268640 Nov 24 18:28:39.015290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 946/1891] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:38 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:40.031652 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:40.032346 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:40.039935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:40.040379 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:40.041141 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:40.041589 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:40.236819 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:40.246705 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3100a432-523b-43b7-bb0f-b9d7154c7508 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1575 microversion: 2.1 time: 0.219081 Nov 24 18:28:40.247282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 946/1892] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:40 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:41.264753 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:41.265353 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:41.273460 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:41.273898 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:41.274660 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:41.275089 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:41.481251 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:41.489362 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e0ab69b4-aaa8-4d04-ba35-f93b232db18e tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1562 microversion: 2.1 time: 0.228310 Nov 24 18:28:41.489923 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 947/1893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:41 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:50.683092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:50.684018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:50.691790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:50.692226 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:50.692987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:50.693415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:50.757045 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-781fb969-3b9f-4eb8-9902-16e4899a4e28 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077630 Nov 24 18:28:50.757609 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 947/1894] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Nov 24 18:28:50 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:28:50.860357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:50.860875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:50.868699 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:50.869140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:50.869900 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:50.870329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:50.933079 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Going to try to terminate instance {{(pid=100948) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:28:51.054105 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a764c9ea-1514-4243-bc44-ba5bc3e5f193 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 204 len: 0 microversion: 2.20 time: 0.197020 Nov 24 18:28:51.055574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 948/1895] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Nov 24 18:28:50 2021] DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:28:51.063888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:51.064637 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:51.072579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:51.073022 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:51.073810 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:51.074266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:51.275255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:51.283762 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:51.285246 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:51.286361 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-952ce5fb-ef6b-49af-ad29-87e043a3c761 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.226162 Nov 24 18:28:51.286917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 948/1896] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:51 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:52.305809 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:52.306534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:52.313779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:52.314072 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:52.314846 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:52.315398 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:52.525821 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:52.534496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:52.536570 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:52.537691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-746942d5-f415-4ca9-b1cb-d99ed7cc1fae tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1724 microversion: 2.20 time: 0.236595 Nov 24 18:28:52.538238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 949/1897] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:52 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 18:28:53.557190 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:53.557727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:53.565218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:53.566049 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:53.567586 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:53.568286 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:53.743929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:53.755512 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:53.757265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '332aad97cf964e0287bd5cfee8d15e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25c25f0344f48eea568f2eb414698a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:28:53.758687 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8b65f195-4f15-476e-9b43-290b91aac5ab tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 200 len: 1656 microversion: 2.20 time: 0.205520 Nov 24 18:28:53.760973 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 949/1898] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:53 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 1656 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 18:28:54.096915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-e93f5f96-5c17-4970-85d9-be0f1d042469 req-26b397ee-ac18-42cf-b2a7-e144b0e63b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe", "name": "network-vif-deleted", "tag": "7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:28:54.098652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:28:54.098652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:28:54.107444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e93f5f96-5c17-4970-85d9-be0f1d042469 req-26b397ee-ac18-42cf-b2a7-e144b0e63b7c service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:54.107913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e93f5f96-5c17-4970-85d9-be0f1d042469 req-26b397ee-ac18-42cf-b2a7-e144b0e63b7c service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:54.126060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-e93f5f96-5c17-4970-85d9-be0f1d042469 req-26b397ee-ac18-42cf-b2a7-e144b0e63b7c service nova] Creating event network-vif-deleted:7dbfb9fa-6ad3-4f5e-bca0-d1b42da9b6d6 for instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe on hv-cinder-81857 Nov 24 18:28:54.132075 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-e93f5f96-5c17-4970-85d9-be0f1d042469 req-26b397ee-ac18-42cf-b2a7-e144b0e63b7c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038753 Nov 24 18:28:54.132684 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 950/1899] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:28:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:28:54.779701 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:54.780389 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:54.787750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:54.788195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:54.788951 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:54.789382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:54.840307 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. Nov 24 18:28:54.840899 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:54.841713 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e52a2e1a-eccb-4e05-9fb0-eeb9a103077c tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 404 len: 111 microversion: 2.20 time: 0.065812 Nov 24 18:28:54.842450 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 950/1900] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Nov 24 18:28:54 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 18:28:54.852086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a296e4be-ce0e-4995-81b2-08b6c79c815b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '.version_select at 0x7f8b10ab6160>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:54.871444 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a296e4be-ce0e-4995-81b2-08b6c79c815b tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363597140" status: 204 len: 0 microversion: 2.20 time: 0.024456 Nov 24 18:28:54.872154 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 951/1901] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 24 18:28:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363597140 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 18:28:58.151921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:58.152616 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:58.159834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:58.161524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:58.162342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:58.162858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:58.213503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. Nov 24 18:28:58.214082 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:58.214888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1d0ee08c-661a-4bd1-ba2b-a7e0312f893f tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 404 len: 111 microversion: 2.1 time: 0.066836 Nov 24 18:28:58.215428 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 951/1902] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:28:58 2021] DELETE /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:58.223781 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:58.224514 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:58.231936 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:58.232386 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:58.244617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:58.245117 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:58.299976 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. Nov 24 18:28:58.300871 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:58.301703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-53b9f215-7b79-49e2-9d0d-31e2f62e4ba5 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe" status: 404 len: 111 microversion: 2.1 time: 0.082129 Nov 24 18:28:58.302262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 952/1903] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:58 2021] GET /compute/v2.1/servers/f2a852a8-43ff-49cb-ae82-7b9eb71d0dfe => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:59.547509 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:59.548035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:59.555463 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:59.555942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:59.556703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:59.557133 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:59.607395 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. Nov 24 18:28:59.608066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:59.608986 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-39218831-a8c2-422f-b0d7-b05409c30e79 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 404 len: 111 microversion: 2.1 time: 0.065163 Nov 24 18:28:59.609537 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 952/1904] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:28:59 2021] DELETE /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:28:59.617356 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:28:59.617971 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] [instance: ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:28:59.625151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:59.625598 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:59.626361 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:28:59.626796 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:28:59.676146 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] HTTP exception thrown: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. Nov 24 18:28:59.676738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] Returning 404 to user: Instance ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:28:59.677543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-46b751e3-15ca-436b-9e0d-a6b2a5c32c39 tempest-AttachVolumeShelveTestJSON-266435622 tempest-AttachVolumeShelveTestJSON-266435622-project] 10.222.0.64 "GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d" status: 404 len: 111 microversion: 2.1 time: 0.063999 Nov 24 18:28:59.678086 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 953/1905] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:28:59 2021] GET /compute/v2.1/servers/ae4b56b2-83d2-41a0-8a2f-10cb00c28b0d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:30:01.978971 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:30:01.983957 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-9c4d25e6-3382-4f2b-b510-5bf646e4b388 req-91983d52-f71a-4d63-b760-e41b6d5a33ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:01.986005 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:01.986647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:01.986647 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:30:01.987154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:01.996281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:30:01.998151 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-9c4d25e6-3382-4f2b-b510-5bf646e4b388 req-91983d52-f71a-4d63-b760-e41b6d5a33ba service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:01.998789 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-9c4d25e6-3382-4f2b-b510-5bf646e4b388 req-91983d52-f71a-4d63-b760-e41b6d5a33ba service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:02.001621 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:02.002272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:02.003366 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:02.003982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:02.026415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-9c4d25e6-3382-4f2b-b510-5bf646e4b388 req-91983d52-f71a-4d63-b760-e41b6d5a33ba service nova] Creating event network-changed:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:30:02.037363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-9c4d25e6-3382-4f2b-b510-5bf646e4b388 req-91983d52-f71a-4d63-b760-e41b6d5a33ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058262 Nov 24 18:30:02.041254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 954/1906] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:02.093953 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:30:02.250119 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1c349382-5780-42bb-8aac-b9a9f53e4943 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "DELETE /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 204 len: 0 microversion: 2.1 time: 0.272768 Nov 24 18:30:02.251211 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 953/1907] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:30:01 2021] DELETE /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:30:02.261129 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:02.261989 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:02.276913 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:02.280120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:02.281049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:02.284254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:03.018135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 42056. Nov 24 18:30:03.080786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:03.090910 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-28814a9c-0a81-45e4-86c9-dafd565237aa tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1568 microversion: 2.1 time: 0.835181 Nov 24 18:30:03.091482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 955/1908] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:02 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1568 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:04.109739 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:04.110654 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:04.129388 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:04.129825 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:04.130733 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:04.131426 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:04.188455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 42076. Nov 24 18:30:04.501770 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:04.510874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d706f90-4b72-421d-8980-33cfc1068b1a tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1449 microversion: 2.1 time: 0.405239 Nov 24 18:30:04.511454 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 954/1909] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:04 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1449 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:04.967949 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-e852dea8-7681-4c26-ba31-7306e0ce9b99 req-5afe22d2-ba0b-49cc-90bd-7c8e4569fd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736ce395-1f9b-46b2-8890-8cc53afa8729", "name": "network-vif-deleted", "tag": "14049677-4550-4720-bae9-0ec4b86404d1"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:04.969520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:04.969520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:30:04.979646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e852dea8-7681-4c26-ba31-7306e0ce9b99 req-5afe22d2-ba0b-49cc-90bd-7c8e4569fd48 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:04.980791 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e852dea8-7681-4c26-ba31-7306e0ce9b99 req-5afe22d2-ba0b-49cc-90bd-7c8e4569fd48 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:05.001247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-e852dea8-7681-4c26-ba31-7306e0ce9b99 req-5afe22d2-ba0b-49cc-90bd-7c8e4569fd48 service nova] Creating event network-vif-deleted:14049677-4550-4720-bae9-0ec4b86404d1 for instance 736ce395-1f9b-46b2-8890-8cc53afa8729 on hv-cinder-81857 Nov 24 18:30:05.007112 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-e852dea8-7681-4c26-ba31-7306e0ce9b99 req-5afe22d2-ba0b-49cc-90bd-7c8e4569fd48 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042476 Nov 24 18:30:05.007932 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 956/1910] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:05.528073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:05.529035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:05.536707 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:05.537239 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:05.538287 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:05.538789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:05.696472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16803f607a6e43f1827f06bfc03421a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64beedb83ebb48e291cc631a123c1504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:05.707706 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f9addb79-b44d-42f9-bec1-6eccd6cec96f tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 200 len: 1220 microversion: 2.1 time: 0.183254 Nov 24 18:30:05.708885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 955/1911] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:05 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 1220 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:06.733207 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:06.733928 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] [instance: 736ce395-1f9b-46b2-8890-8cc53afa8729] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:06.742450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:06.742889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:06.743885 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:06.744319 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:06.796038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] HTTP exception thrown: Instance 736ce395-1f9b-46b2-8890-8cc53afa8729 could not be found. Nov 24 18:30:06.796638 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Returning 404 to user: Instance 736ce395-1f9b-46b2-8890-8cc53afa8729 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:30:06.797494 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-526dfcb7-e7a0-4352-99c9-9fc7c51331be tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729" status: 404 len: 111 microversion: 2.1 time: 0.068512 Nov 24 18:30:06.798048 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 957/1912] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:06 2021] GET /compute/v2.1/servers/736ce395-1f9b-46b2-8890-8cc53afa8729 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:30:07.075338 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fad87826-d51c-4483-84ad-3281a8f00608 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] Calling method '.version_select at 0x7f8b102158b0>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:07.117477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fad87826-d51c-4483-84ad-3281a8f00608 tempest-TestShelveInstance-2021488881 tempest-TestShelveInstance-2021488881-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1422889255" status: 202 len: 0 microversion: 2.1 time: 0.048848 Nov 24 18:30:07.118759 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 956/1913] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Nov 24 18:30:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1422889255 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:30:13.610619 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1159273856", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "29791584-a22b-4ee3-a585-bbe6c348d18c"}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:13.679636 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] validate_networks() for [('29791584-a22b-4ee3-a585-bbe6c348d18c', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:30:14.216380 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:30:14.216895 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:30:14.217481 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:30:14.217952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:30:14.218430 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:30:14.228000 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:14.228548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:14.229416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:14.229927 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:14.248321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Getting quotas for project d9771725dedf4336bda5e0e9bf7bbc9f. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:30:14.252442 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Getting quotas for user 2e25e1f0be7e48cda959c18cbba59e19 and project d9771725dedf4336bda5e0e9bf7bbc9f. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:30:14.264371 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:30:14.266813 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:30:14.312605 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-36835146-273e-4d08-a256-e29afd723c6e tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705700 Nov 24 18:30:14.313261 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 958/1914] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:30:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:30:14.323516 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c0b29388-39a3-4681-80ae-ddb96ef8bf4d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:14.326448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c0b29388-39a3-4681-80ae-ddb96ef8bf4d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:14.407101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c0b29388-39a3-4681-80ae-ddb96ef8bf4d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:14.426885 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c0b29388-39a3-4681-80ae-ddb96ef8bf4d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1214 microversion: 2.1 time: 0.106847 Nov 24 18:30:14.429280 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 957/1915] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:14 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:15.451265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:15.452663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:15.461290 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:15.461838 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:15.462727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:15.463238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:15.733774 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:15.744451 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-be7fa336-8be4-4905-8262-d0119e4bd064 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1274 microversion: 2.1 time: 0.298073 Nov 24 18:30:15.756094 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 959/1916] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:15 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1274 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:16.761836 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:16.762430 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:16.770079 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:16.770564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:16.771882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:16.772354 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:16.897032 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:16.906661 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e3187e83-a75a-4585-81c6-7b7b492b5ca1 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1272 microversion: 2.1 time: 0.148370 Nov 24 18:30:16.907396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 958/1917] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:16 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:17.925254 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:17.926109 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:17.946012 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:17.946458 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:17.947257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:17.947703 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:18.907208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:18.917996 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5a888eca-3857-43f5-8acc-125566b63e77 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.996565 Nov 24 18:30:18.919030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 960/1918] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:17 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:19.562113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-7202ab3d-5803-4feb-9f0e-a4b5106e7340 req-8122620a-097e-4ca1-9d56-81dd06422ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00cbe36b-3713-459e-865e-fd42485d9e56", "tag": "ecab183f-49a8-44ae-8e7c-90e7903bed80"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:19.563897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:19.563897 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:30:19.575727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-7202ab3d-5803-4feb-9f0e-a4b5106e7340 req-8122620a-097e-4ca1-9d56-81dd06422ebb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:19.576429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-7202ab3d-5803-4feb-9f0e-a4b5106e7340 req-8122620a-097e-4ca1-9d56-81dd06422ebb service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:19.598429 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-7202ab3d-5803-4feb-9f0e-a4b5106e7340 req-8122620a-097e-4ca1-9d56-81dd06422ebb service nova] Creating event network-changed:ecab183f-49a8-44ae-8e7c-90e7903bed80 for instance 00cbe36b-3713-459e-865e-fd42485d9e56 on hv-cinder-81857 Nov 24 18:30:19.604159 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-7202ab3d-5803-4feb-9f0e-a4b5106e7340 req-8122620a-097e-4ca1-9d56-81dd06422ebb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060740 Nov 24 18:30:19.604855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 959/1919] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:19.936177 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:19.936782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:19.945042 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:19.945559 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:19.946431 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:19.946914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:20.399017 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:20.407314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-bb941245-60a3-400d-97bd-20f7ecbe142d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.475113 Nov 24 18:30:20.408135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 961/1920] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:19 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:21.425249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:21.427932 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:21.435200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:21.435673 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:21.436636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:21.437074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:21.659904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:21.669189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b9efc13c-60f2-419d-9cb0-01e68211c0b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.248172 Nov 24 18:30:21.669765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 960/1921] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:21 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:22.688239 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:22.688934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:22.697625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:22.698080 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:22.698868 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:22.699308 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:22.954110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:22.964924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-4fc158ce-42c0-4d10-a33d-28d15869e943 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.280281 Nov 24 18:30:22.966352 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 962/1922] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:22 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:23.985041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:23.986833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:23.998715 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:23.999157 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:24.000180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:24.000788 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:24.598391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:24.607824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cfb8ae0e-4d6c-4bf8-838f-7fa83c6ef25c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.627839 Nov 24 18:30:24.608671 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 961/1923] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:23 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:25.357258 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-7ac0b106-db0e-46c4-b129-67fca2707afc req-2a596d7e-aca7-4ce4-a69e-962b3b2596b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cbe36b-3713-459e-865e-fd42485d9e56", "name": "network-vif-plugged", "status": "completed", "tag": "ecab183f-49a8-44ae-8e7c-90e7903bed80"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:25.359429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:25.359429 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:30:25.369528 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7ac0b106-db0e-46c4-b129-67fca2707afc req-2a596d7e-aca7-4ce4-a69e-962b3b2596b0 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:25.369914 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-7ac0b106-db0e-46c4-b129-67fca2707afc req-2a596d7e-aca7-4ce4-a69e-962b3b2596b0 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:25.387341 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-7ac0b106-db0e-46c4-b129-67fca2707afc req-2a596d7e-aca7-4ce4-a69e-962b3b2596b0 service nova] Creating event network-vif-plugged:ecab183f-49a8-44ae-8e7c-90e7903bed80 for instance 00cbe36b-3713-459e-865e-fd42485d9e56 on hv-cinder-81857 Nov 24 18:30:25.393495 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-7ac0b106-db0e-46c4-b129-67fca2707afc req-2a596d7e-aca7-4ce4-a69e-962b3b2596b0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Nov 24 18:30:25.394441 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 963/1924] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:25.625979 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:25.627177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:25.638809 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:25.639513 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:25.640570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:25.641296 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:26.035023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:26.048949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-39255f1e-30fb-4c23-9013-3fbd85ab3dfa tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1314 microversion: 2.1 time: 0.426460 Nov 24 18:30:26.049990 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 962/1925] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:25 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:27.068038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:27.068879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:27.076581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:27.077394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:27.078585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:27.079238 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:27.377223 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:27.387375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0542ec63-e929-4393-9822-9e68b3d478cc tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1498 microversion: 2.1 time: 0.323287 Nov 24 18:30:27.388582 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 964/1926] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:27 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:28.173675 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:28.174766 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:28.182882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:28.183318 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:28.184727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:28.184816 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:28.252025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:30:28.429535 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8fb19743-3780-47c0-9057-9551f196d812 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "DELETE /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 204 len: 0 microversion: 2.1 time: 0.259050 Nov 24 18:30:28.430542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 963/1927] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:30:28 2021] DELETE /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 18:30:28.446045 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:28.447193 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:28.476735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:28.477511 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:28.479004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:28.491733 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:28.806003 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:28.815163 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cdc70b27-98ee-40c7-ba8c-ead9ae5df135 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1504 microversion: 2.1 time: 0.377469 Nov 24 18:30:28.816221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 965/1928] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:28 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:29.835807 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:29.836651 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:29.844540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:29.844984 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:29.845764 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:29.846195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:30.063167 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:30.072258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-4d1279ab-40e3-4391-a7db-615efbde19c7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1504 microversion: 2.1 time: 0.242050 Nov 24 18:30:30.076099 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 964/1929] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:29 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:31.091484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:31.092125 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:31.112135 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:31.112580 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:31.113357 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:31.114496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:31.175362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-3f958b69-9e9b-430e-a018-f5a5efd72a94 req-00bdf3e7-71d0-4d53-a175-2361af2e15d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00cbe36b-3713-459e-865e-fd42485d9e56", "name": "network-vif-deleted", "tag": "ecab183f-49a8-44ae-8e7c-90e7903bed80"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:31.183081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:31.183081 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:30:31.193850 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3f958b69-9e9b-430e-a018-f5a5efd72a94 req-00bdf3e7-71d0-4d53-a175-2361af2e15d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:31.194580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3f958b69-9e9b-430e-a018-f5a5efd72a94 req-00bdf3e7-71d0-4d53-a175-2361af2e15d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:31.214735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-3f958b69-9e9b-430e-a018-f5a5efd72a94 req-00bdf3e7-71d0-4d53-a175-2361af2e15d7 service nova] Creating event network-vif-deleted:ecab183f-49a8-44ae-8e7c-90e7903bed80 for instance 00cbe36b-3713-459e-865e-fd42485d9e56 on hv-cinder-81857 Nov 24 18:30:31.220350 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-3f958b69-9e9b-430e-a018-f5a5efd72a94 req-00bdf3e7-71d0-4d53-a175-2361af2e15d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048217 Nov 24 18:30:31.227632 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 965/1930] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:30:31.366472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:31.375668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c0ab45c6-6b32-4a41-96ab-cae0458da73f tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 200 len: 1462 microversion: 2.1 time: 0.287746 Nov 24 18:30:31.381948 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 966/1931] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:31 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 1462 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:32.399615 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:32.400315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 00cbe36b-3713-459e-865e-fd42485d9e56] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:32.415172 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:32.417092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:32.418041 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:32.418484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:32.497020 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] HTTP exception thrown: Instance 00cbe36b-3713-459e-865e-fd42485d9e56 could not be found. Nov 24 18:30:32.499025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Returning 404 to user: Instance 00cbe36b-3713-459e-865e-fd42485d9e56 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:30:32.499910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c73f0523-3c5e-4f38-9840-4b81c5b78c31 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56" status: 404 len: 111 microversion: 2.1 time: 0.105336 Nov 24 18:30:32.501029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 966/1932] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:32 2021] GET /compute/v2.1/servers/00cbe36b-3713-459e-865e-fd42485d9e56 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:30:32.644653 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1754572104", "imageRef": "3786c9b5-815b-43d8-b8ae-d4313cb6971d", "flavorRef": "452", "networks": [{"uuid": "29791584-a22b-4ee3-a585-bbe6c348d18c"}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:32.736399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] validate_networks() for [('29791584-a22b-4ee3-a585-bbe6c348d18c', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:30:33.650172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:30:33.650970 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:30:33.651256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:30:33.651705 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:30:33.652130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:30:33.665915 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:33.687510 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:33.688771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:33.689394 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:33.744497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Getting quotas for project d9771725dedf4336bda5e0e9bf7bbc9f. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:30:33.757804 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Getting quotas for user 2e25e1f0be7e48cda959c18cbba59e19 and project d9771725dedf4336bda5e0e9bf7bbc9f. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:30:33.786669 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:30:33.789326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3786c9b5-815b-43d8-b8ae-d4313cb6971d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:30:33.857803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-50fa29dd-3460-4fdc-aa3d-fa4939261a84 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219653 Nov 24 18:30:33.863383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 967/1933] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:30:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:30:33.871564 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-fa344b10-aa86-449d-9444-6c13afcb8017 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:33.872888 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-fa344b10-aa86-449d-9444-6c13afcb8017 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:34.193300 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-fa344b10-aa86-449d-9444-6c13afcb8017 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:34.205639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-fa344b10-aa86-449d-9444-6c13afcb8017 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1214 microversion: 2.1 time: 0.338617 Nov 24 18:30:34.206869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 967/1934] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:33 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:35.226209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0c48a891-b3f0-45d6-bef2-af65254e2a4c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:35.227480 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0c48a891-b3f0-45d6-bef2-af65254e2a4c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:35.306014 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0c48a891-b3f0-45d6-bef2-af65254e2a4c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:35.316002 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0c48a891-b3f0-45d6-bef2-af65254e2a4c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1214 microversion: 2.1 time: 0.095841 Nov 24 18:30:35.325588 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 968/1935] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:35 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:36.334165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6d813b62-1853-403f-abf2-303a4fcf2b10 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:36.335121 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6d813b62-1853-403f-abf2-303a4fcf2b10 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:36.418334 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-6d813b62-1853-403f-abf2-303a4fcf2b10 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:36.428467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6d813b62-1853-403f-abf2-303a4fcf2b10 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1214 microversion: 2.1 time: 0.099237 Nov 24 18:30:36.429310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 968/1936] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:36 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:37.447323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-1cf9b3fc-d33d-4bf2-9509-1c2d9e155032 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:37.448403 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-1cf9b3fc-d33d-4bf2-9509-1c2d9e155032 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:37.558248 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-1cf9b3fc-d33d-4bf2-9509-1c2d9e155032 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:37.565935 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-1cf9b3fc-d33d-4bf2-9509-1c2d9e155032 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1214 microversion: 2.1 time: 0.124155 Nov 24 18:30:37.567458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 969/1937] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:37 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:37.586226 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Action: 'create', calling method: .version_select at 0x7f8b0b6ec0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-492530520"}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:37.609344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for project cb19756ada554e398ec440fa707bd611. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:30:37.614073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for user 6dda2a4913d343878c0e54cdcbddf6f4 and project cb19756ada554e398ec440fa707bd611. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:30:37.857987 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for project cb19756ada554e398ec440fa707bd611. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:30:37.862035 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for user 6dda2a4913d343878c0e54cdcbddf6f4 and project cb19756ada554e398ec440fa707bd611. Resources: {'key_pairs'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:30:37.876677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-50bbc0a0-2788-4ff6-b95b-7d7b80d3a465 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.579110 Nov 24 18:30:37.877179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 969/1938] 10.222.0.64 () {60 vars in 1157 bytes} [Wed Nov 24 18:30:37 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:38.591683 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:38.592781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:38.604342 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:38.604775 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:38.605749 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:38.606176 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:38.733678 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:38.744744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-da653a0a-0e08-4a5f-9c12-c30671d148dd tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1218 microversion: 2.1 time: 0.156717 Nov 24 18:30:38.745258 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 970/1939] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:38 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:39.762584 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:39.764010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:39.775591 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:39.778448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:39.779244 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:39.779742 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:39.935437 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:39.945929 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-086c9399-9ae6-4803-899b-630f43d7c915 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1272 microversion: 2.1 time: 0.187361 Nov 24 18:30:39.947047 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 970/1940] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:39 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:40.963259 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:40.963871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:40.971007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:40.971449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:40.972266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:40.972958 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:41.220590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:41.234362 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-10dec402-924e-4507-a216-4718167a0080 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.274651 Nov 24 18:30:41.235719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 971/1941] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:40 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:41.602525 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-91f0eeac-d767-4aab-b084-1ca7aa3d5c36 req-3453545f-1399-4260-bda4-a68c83143f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13533042-6110-47b1-8233-1dad27408831", "tag": "8407bdb2-d684-4375-b19d-56364ce45a4a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:41.604988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:41.604988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:30:41.616888 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-91f0eeac-d767-4aab-b084-1ca7aa3d5c36 req-3453545f-1399-4260-bda4-a68c83143f6f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:41.617795 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-91f0eeac-d767-4aab-b084-1ca7aa3d5c36 req-3453545f-1399-4260-bda4-a68c83143f6f service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:41.639960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-91f0eeac-d767-4aab-b084-1ca7aa3d5c36 req-3453545f-1399-4260-bda4-a68c83143f6f service nova] Creating event network-changed:8407bdb2-d684-4375-b19d-56364ce45a4a for instance 13533042-6110-47b1-8233-1dad27408831 on hv-cinder-81857 Nov 24 18:30:41.646849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-91f0eeac-d767-4aab-b084-1ca7aa3d5c36 req-3453545f-1399-4260-bda4-a68c83143f6f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047269 Nov 24 18:30:41.647678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 971/1942] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:42.253214 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:42.256096 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:42.268797 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:42.269556 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:42.271781 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:42.272419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:42.525373 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:42.533590 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-954e2fc7-5759-43d0-b998-4c45fed9edb0 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.284712 Nov 24 18:30:42.534153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 972/1943] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:42 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:43.553771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:43.554574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:43.562340 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:43.562782 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:43.563543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:43.564172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:43.794198 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:43.802825 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-87252e72-2375-4401-aa17-d822f7c32c58 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.254538 Nov 24 18:30:43.803389 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 972/1944] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:43 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:44.820717 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:44.821358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:44.828641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:44.829074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:44.829826 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:44.830249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:45.033503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:45.042113 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-33fea463-3302-46b7-aaaf-fbef04fb62b6 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.226183 Nov 24 18:30:45.042670 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 973/1945] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:44 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:46.059328 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:46.059982 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:46.067178 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:46.067642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:46.068409 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:46.068842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:46.265803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:46.274169 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9ac5806e-29cd-4980-9810-473b4d7a3935 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.218599 Nov 24 18:30:46.274734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 973/1946] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:46 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:47.286018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-69ecc832-ae21-45d9-b28a-ceb472f0a02d req-14575ff9-c37c-4d31-ab0e-1177b8551d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13533042-6110-47b1-8233-1dad27408831", "name": "network-vif-plugged", "status": "completed", "tag": "8407bdb2-d684-4375-b19d-56364ce45a4a"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:47.287845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:47.287845 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:30:47.291372 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:47.291926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:47.296600 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-69ecc832-ae21-45d9-b28a-ceb472f0a02d req-14575ff9-c37c-4d31-ab0e-1177b8551d12 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:47.297186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-69ecc832-ae21-45d9-b28a-ceb472f0a02d req-14575ff9-c37c-4d31-ab0e-1177b8551d12 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:47.299811 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:47.300262 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:47.301317 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:47.301755 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:47.313920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-69ecc832-ae21-45d9-b28a-ceb472f0a02d req-14575ff9-c37c-4d31-ab0e-1177b8551d12 service nova] Creating event network-vif-plugged:8407bdb2-d684-4375-b19d-56364ce45a4a for instance 13533042-6110-47b1-8233-1dad27408831 on hv-cinder-81857 Nov 24 18:30:47.323411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-69ecc832-ae21-45d9-b28a-ceb472f0a02d req-14575ff9-c37c-4d31-ab0e-1177b8551d12 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041052 Nov 24 18:30:47.324453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 974/1947] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:47.574165 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:47.582283 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-46844b45-0b5b-4591-b885-ce75f9f10ce2 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.294868 Nov 24 18:30:47.583067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 974/1948] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:47 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:30:48.607782 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:48.608465 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:48.617812 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:48.618182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:48.619008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:48.619434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:48.846295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:48.855195 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aeabfa33-c250-439e-a3af-e608e15dd85c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1314 microversion: 2.1 time: 0.251421 Nov 24 18:30:48.856453 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 975/1949] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:48 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:49.877041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:49.877041 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:49.887516 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:49.887990 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:49.888831 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:49.889265 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:50.204496 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:50.215837 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-323ee75a-2756-4a85-9add-37fac1044b0d tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1498 microversion: 2.1 time: 0.345427 Nov 24 18:30:50.216423 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 975/1950] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:49 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1498 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:51.021413 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:51.022035 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:51.029604 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:51.030074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:51.030949 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:51.031419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:51.100100 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:30:51.225874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0f2e7d45-e127-4c3f-baf4-267223cb1022 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "DELETE /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 204 len: 0 microversion: 2.1 time: 0.208190 Nov 24 18:30:51.227153 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 976/1951] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:30:51 2021] DELETE /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:30:51.238270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:51.239030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:51.251421 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:51.251964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:51.252853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:51.253381 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:51.489271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:51.501118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c07a4901-b55f-435e-8945-86cd8c17071b tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1504 microversion: 2.1 time: 0.268413 Nov 24 18:30:51.502947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 976/1952] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:51 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:52.518828 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:52.519639 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:52.527580 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:52.528043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:52.528800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:52.529221 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:52.581345 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:30:52.584763 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:30:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 (ip 10.222.0.64) !!! Nov 24 18:30:52.747244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:52.755849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-62ff3d97-8982-4d81-81c1-700041f1c927 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1504 microversion: 2.1 time: 0.240469 Nov 24 18:30:52.756483 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 977/1953] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:52 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:53.588617 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-e2302a3e-4530-4e41-a353-0dfc972253a1 req-ef6d6cd1-7090-4060-8b6b-a916d1ecb9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13533042-6110-47b1-8233-1dad27408831", "name": "network-vif-deleted", "tag": "8407bdb2-d684-4375-b19d-56364ce45a4a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:30:53.590259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:30:53.590259 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:30:53.601978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e2302a3e-4530-4e41-a353-0dfc972253a1 req-ef6d6cd1-7090-4060-8b6b-a916d1ecb9e3 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:53.601978 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e2302a3e-4530-4e41-a353-0dfc972253a1 req-ef6d6cd1-7090-4060-8b6b-a916d1ecb9e3 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:53.617037 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-e2302a3e-4530-4e41-a353-0dfc972253a1 req-ef6d6cd1-7090-4060-8b6b-a916d1ecb9e3 service nova] Creating event network-vif-deleted:8407bdb2-d684-4375-b19d-56364ce45a4a for instance 13533042-6110-47b1-8233-1dad27408831 on hv-cinder-81857 Nov 24 18:30:53.622652 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-e2302a3e-4530-4e41-a353-0dfc972253a1 req-ef6d6cd1-7090-4060-8b6b-a916d1ecb9e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037662 Nov 24 18:30:53.623625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 977/1954] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:30:53.773834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:53.774477 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:53.781642 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:53.782073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:53.782817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:53.783238 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:53.864534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:53.864982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:53.865419 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.objects.instance [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lazy-loading 'fault' on Instance uuid 13533042-6110-47b1-8233-1dad27408831 {{(pid=100949) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:30:53.927220 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e25e1f0be7e48cda959c18cbba59e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9771725dedf4336bda5e0e9bf7bbc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:30:53.935779 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-636dce59-7b8b-4d8e-828c-09adf7fe8b3c tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 200 len: 1304 microversion: 2.1 time: 0.166785 Nov 24 18:30:53.936356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 978/1955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:53 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:30:54.954469 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:30:54.955095 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] [instance: 13533042-6110-47b1-8233-1dad27408831] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:30:54.963487 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:54.963954 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:54.964735 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:30:54.965160 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:30:55.016234 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] HTTP exception thrown: Instance 13533042-6110-47b1-8233-1dad27408831 could not be found. Nov 24 18:30:55.016830 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] Returning 404 to user: Instance 13533042-6110-47b1-8233-1dad27408831 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:30:55.017643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-7e9507d8-80d3-48fa-ad63-bf3f9662a3f7 tempest-VolumesActionsTest-1625918806 tempest-VolumesActionsTest-1625918806-project] 10.222.0.64 "GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831" status: 404 len: 111 microversion: 2.1 time: 0.067390 Nov 24 18:30:55.018233 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 978/1956] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:30:54 2021] GET /compute/v2.1/servers/13533042-6110-47b1-8233-1dad27408831 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:31:02.113432 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1588447008", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-492530520", "security_groups": [{"name": "tempest-secgroup-smoke-2031811991"}], "block_device_mapping_v2": [{"uuid": "0546a6d5-c9a1-49ee-868e-964b166e5162", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ed2dbe-8edd-4e75-a06b-5078acde0a2c"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:31:02.306057 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] validate_networks() for [('43ed2dbe-8edd-4e75-a06b-5078acde0a2c', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:31:03.157947 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:31:03.159027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:31:03.159727 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:31:03.161177 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:31:03.162327 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:31:03.172792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:03.173484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:03.174484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:03.175098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:03.194507 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:31:03.199208 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for user 6dda2a4913d343878c0e54cdcbddf6f4 and project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:31:03.318721 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:31:03.321023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0546a6d5-c9a1-49ee-868e-964b166e5162',volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:31:03.552924 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b91dc4b7-0fca-48db-ad04-c21d167b75d1 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.443034 Nov 24 18:31:03.554194 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 979/1957] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:31:02 2021] POST /compute/v2.1/servers => generated 406 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:31:03.566054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-83bdee9b-32f3-49dd-b04f-f2eb6f591f54 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:03.566054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-83bdee9b-32f3-49dd-b04f-f2eb6f591f54 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:03.665256 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-83bdee9b-32f3-49dd-b04f-f2eb6f591f54 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:03.675730 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-83bdee9b-32f3-49dd-b04f-f2eb6f591f54 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1094 microversion: 2.1 time: 0.115422 Nov 24 18:31:03.676947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 979/1958] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:03 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:04.694044 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:04.694655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:04.702742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:04.703186 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:04.711469 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:04.711981 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:04.857140 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:04.868092 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c7edd65b-0fb6-4aba-af7f-d3ae4a471229 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1192 microversion: 2.1 time: 0.178220 Nov 24 18:31:04.868942 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 980/1959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:04 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1192 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:05.897331 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:05.899153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:05.909803 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:05.910620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:05.911829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:05.912746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:06.763710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:06.773064 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-94fb9e18-ed51-41af-9757-efa7371c24f0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1278 microversion: 2.1 time: 0.888361 Nov 24 18:31:06.774127 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 980/1960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:05 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1278 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:07.790524 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:07.792054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:07.810120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:07.810574 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:07.811363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:07.811826 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:07.853274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-781780de-9ebf-4b6b-a9d3-939dc3f3dc8c req-b02a0ee8-ed80-4e47-827d-1fda3a11e10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82ecc95-bc70-4016-a30b-2db492974044", "tag": "4841b046-fa59-4e17-895a-af0a34bc0d8b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:31:07.856359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:31:07.856359 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:31:07.869602 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-781780de-9ebf-4b6b-a9d3-939dc3f3dc8c req-b02a0ee8-ed80-4e47-827d-1fda3a11e10a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:07.870539 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-781780de-9ebf-4b6b-a9d3-939dc3f3dc8c req-b02a0ee8-ed80-4e47-827d-1fda3a11e10a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:07.898811 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-781780de-9ebf-4b6b-a9d3-939dc3f3dc8c req-b02a0ee8-ed80-4e47-827d-1fda3a11e10a service nova] Creating event network-changed:4841b046-fa59-4e17-895a-af0a34bc0d8b for instance c82ecc95-bc70-4016-a30b-2db492974044 on hv-cinder-81857 Nov 24 18:31:07.909098 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-781780de-9ebf-4b6b-a9d3-939dc3f3dc8c req-b02a0ee8-ed80-4e47-827d-1fda3a11e10a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202330 Nov 24 18:31:07.909903 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 981/1961] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:31:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:31:08.281281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:08.305749 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-b2aff221-911a-44d6-8ad2-8d626f20b3f3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.520114 Nov 24 18:31:08.306336 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 981/1962] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:07 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:09.328297 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:09.329740 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:09.338411 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:09.339255 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:09.340312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:09.340963 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:09.576228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:09.590236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e45495e9-ba80-454d-b618-32d5d7317fd4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.267228 Nov 24 18:31:09.592130 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 982/1963] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:09 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:10.613010 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:10.613899 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:10.624543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:10.625011 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:10.628147 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:10.628621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:10.883561 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:10.903392 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-c6b3dcc9-f0d9-4121-802e-f4771558977f tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.293573 Nov 24 18:31:10.907618 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 982/1964] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:10 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:11.925458 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:11.926312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:11.936180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:11.936180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:11.938928 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:11.939434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:12.178086 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:12.189378 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-63d5101a-1c78-4dc2-ba6d-457b4af1cedd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.267457 Nov 24 18:31:12.189952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 983/1965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:11 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:13.207194 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:13.208847 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:13.217126 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:13.217544 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:13.218282 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:13.218750 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:13.465818 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:13.476036 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-de41d160-fe88-480e-b0e8-feda416835d3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.272255 Nov 24 18:31:13.479130 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 983/1966] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:13 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:14.492883 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:14.493531 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:14.502073 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:14.502534 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:14.503323 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:14.503790 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:14.725265 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:14.734605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0a19a4fb-b9eb-49bb-b787-d537990c73c2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.245654 Nov 24 18:31:14.735185 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 984/1967] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:14 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:15.753108 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:15.754405 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:15.763992 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:15.764585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:15.765484 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:15.766013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:16.046600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:16.057301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f8e84e4d-89f6-4ce6-b8c7-827d6eece759 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.307830 Nov 24 18:31:16.058697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 984/1968] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:15 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:17.079653 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:17.081029 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:17.090310 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:17.090849 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:17.092014 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:17.092674 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:17.332228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:17.342398 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c72a5d1c-6724-42bb-9431-fca054d96a3b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.266412 Nov 24 18:31:17.343684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 985/1969] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:17 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:17.564096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-479b6d46-7509-4c0d-b0b2-9bbc9ef1963a req-6be0bbaf-326b-44d8-b32f-b50a58467ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82ecc95-bc70-4016-a30b-2db492974044", "name": "network-vif-plugged", "status": "completed", "tag": "4841b046-fa59-4e17-895a-af0a34bc0d8b"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:31:17.564643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:31:17.564643 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:31:17.579887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-479b6d46-7509-4c0d-b0b2-9bbc9ef1963a req-6be0bbaf-326b-44d8-b32f-b50a58467ee7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:17.580865 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-479b6d46-7509-4c0d-b0b2-9bbc9ef1963a req-6be0bbaf-326b-44d8-b32f-b50a58467ee7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:17.600771 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-479b6d46-7509-4c0d-b0b2-9bbc9ef1963a req-6be0bbaf-326b-44d8-b32f-b50a58467ee7 service nova] Creating event network-vif-plugged:4841b046-fa59-4e17-895a-af0a34bc0d8b for instance c82ecc95-bc70-4016-a30b-2db492974044 on hv-cinder-81857 Nov 24 18:31:17.606013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-479b6d46-7509-4c0d-b0b2-9bbc9ef1963a req-6be0bbaf-326b-44d8-b32f-b50a58467ee7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048553 Nov 24 18:31:17.606947 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 985/1970] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:31:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:31:18.360587 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:18.361199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:18.369552 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:18.369992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:18.370814 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:18.371179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:18.743154 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:18.762985 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c8a1a4e1-aeed-44d5-ae1a-704bc1f356da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1266 microversion: 2.1 time: 0.406007 Nov 24 18:31:18.763541 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 986/1971] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:18 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:19.780099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:19.780785 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:19.789005 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:19.789443 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:19.790192 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:19.790622 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:20.002417 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.011488 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-097234c5-18e1-4099-be4b-1d76bc623187 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1452 microversion: 2.1 time: 0.235519 Nov 24 18:31:20.012070 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 986/1972] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:19 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:20.028333 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:31:20.028961 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:31:20.036169 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:20.036570 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:20.037356 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:20.037824 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:20.241337 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:31:20.249438 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-86674ec6-3edc-4a9b-8973-fdd948d0b446 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1452 microversion: 2.1 time: 0.224789 Nov 24 18:31:20.249974 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 987/1973] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:31:20 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:31:22.916292 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-b978beab-adb8-4e46-8bda-42403b4371c2 req-ecd025c4-0dba-4ceb-9cb1-73948f3269d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82ecc95-bc70-4016-a30b-2db492974044", "tag": "4841b046-fa59-4e17-895a-af0a34bc0d8b"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:31:22.918034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:31:22.918034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:31:22.927119 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-b978beab-adb8-4e46-8bda-42403b4371c2 req-ecd025c4-0dba-4ceb-9cb1-73948f3269d3 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:31:22.927926 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-b978beab-adb8-4e46-8bda-42403b4371c2 req-ecd025c4-0dba-4ceb-9cb1-73948f3269d3 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:31:22.944101 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-b978beab-adb8-4e46-8bda-42403b4371c2 req-ecd025c4-0dba-4ceb-9cb1-73948f3269d3 service nova] Creating event network-changed:4841b046-fa59-4e17-895a-af0a34bc0d8b for instance c82ecc95-bc70-4016-a30b-2db492974044 on hv-cinder-81857 Nov 24 18:31:22.949342 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-b978beab-adb8-4e46-8bda-42403b4371c2 req-ecd025c4-0dba-4ceb-9cb1-73948f3269d3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Nov 24 18:31:22.950149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 987/1974] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:33:14.583007 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:33:14.583641 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:33:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:33:20.894266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:20.894919 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:20.898027 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:33:20.903804 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:20.904247 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:20.905112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:20.905422 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:20.964882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:33:21.073744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b94107ec-4ac3-4bc2-8654-3a71b147f7d6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 204 len: 0 microversion: 2.1 time: 0.182456 Nov 24 18:33:21.074759 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 988/1975] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:33:20 2021] DELETE /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:33:21.080919 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 24 18:33:21.084683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:21.085403 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:21.093449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:21.093897 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:21.094658 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:21.095093 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:21.291067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:21.299793 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d4191f0e-d8cf-4726-a94e-09a04a8ffebc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1577 microversion: 2.1 time: 0.220435 Nov 24 18:33:21.300343 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 988/1976] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:21 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:22.318182 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:22.318866 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:22.336397 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:22.336874 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:22.337649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:22.338599 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:22.374995 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 43202. Nov 24 18:33:22.544266 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:22.552481 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-68369377-8708-423a-a49d-053c0a473dbc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1577 microversion: 2.1 time: 0.238400 Nov 24 18:33:22.553320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 989/1977] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:22 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:23.570053 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:23.570779 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:23.590056 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:23.590497 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:23.591270 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:23.591727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:23.647621 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 43206. Nov 24 18:33:23.940642 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:23.950247 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-39613004-5870-4279-94ed-3fc360b7015d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1577 microversion: 2.1 time: 0.383877 Nov 24 18:33:23.951025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 989/1978] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:23 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1577 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:24.440016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-3950b0cf-c175-4b1c-8c19-8d7726641bfe req-6609b341-26f0-481a-a28b-1bad4c420dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82ecc95-bc70-4016-a30b-2db492974044", "name": "network-vif-deleted", "tag": "4841b046-fa59-4e17-895a-af0a34bc0d8b"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:33:24.442295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:33:24.442295 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:33:24.453690 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3950b0cf-c175-4b1c-8c19-8d7726641bfe req-6609b341-26f0-481a-a28b-1bad4c420dc9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:24.454393 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-3950b0cf-c175-4b1c-8c19-8d7726641bfe req-6609b341-26f0-481a-a28b-1bad4c420dc9 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:24.486802 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-3950b0cf-c175-4b1c-8c19-8d7726641bfe req-6609b341-26f0-481a-a28b-1bad4c420dc9 service nova] Creating event network-vif-deleted:4841b046-fa59-4e17-895a-af0a34bc0d8b for instance c82ecc95-bc70-4016-a30b-2db492974044 on hv-cinder-81857 Nov 24 18:33:24.492074 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-3950b0cf-c175-4b1c-8c19-8d7726641bfe req-6609b341-26f0-481a-a28b-1bad4c420dc9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056247 Nov 24 18:33:24.492655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 990/1979] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:33:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:33:24.967548 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:24.969096 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:24.979190 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:24.979670 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:24.980453 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:24.980889 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:25.055279 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:25.055758 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:25.056215 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.objects.instance [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lazy-loading 'fault' on Instance uuid c82ecc95-bc70-4016-a30b-2db492974044 {{(pid=100948) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Nov 24 18:33:25.245363 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:25.253448 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-cc839267-5b3e-4219-bea4-ab01390a169d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 200 len: 1230 microversion: 2.1 time: 0.290149 Nov 24 18:33:25.254004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 990/1980] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:24 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 1230 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:26.271546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:26.272267 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:26.280274 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:26.280719 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:26.281479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:26.281911 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:26.330510 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] HTTP exception thrown: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. Nov 24 18:33:26.331094 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Returning 404 to user: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:33:26.331923 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-6c91d897-800e-434c-880c-ae4b883095b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 404 len: 111 microversion: 2.1 time: 0.064552 Nov 24 18:33:26.332584 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 991/1981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:26 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:33:26.440634 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1575205061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-492530520", "security_groups": [{"name": "tempest-secgroup-smoke-2031811991"}], "block_device_mapping_v2": [{"uuid": "0546a6d5-c9a1-49ee-868e-964b166e5162", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ed2dbe-8edd-4e75-a06b-5078acde0a2c"}]}} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:33:26.601777 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.network.neutron [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] validate_networks() for [('43ed2dbe-8edd-4e75-a06b-5078acde0a2c', None, None, None)] {{(pid=100948) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:33:27.232674 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:33:27.233120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image limits 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:33:27.233587 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:33:27.233991 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image pref 0:0:0 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:33:27.234401 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.virt.hardware [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100948) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:33:27.242620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:27.243067 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:27.243882 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:27.245001 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:27.262267 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:33:27.266314 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.quota [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for user 6dda2a4913d343878c0e54cdcbddf6f4 and project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100948) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:33:27.367241 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Going to run 1 instances... {{(pid=100948) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:33:27.370050 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0546a6d5-c9a1-49ee-868e-964b166e5162',volume_size=None,volume_type=None)] {{(pid=100948) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:33:27.532713 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-1e9a9504-ea96-48c5-80de-b04e092bc5da tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095939 Nov 24 18:33:27.533704 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 991/1982] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:33:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 18:33:27.544640 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-0d142276-93c1-4360-b580-5f24b4ca3e6e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:27.545330 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-0d142276-93c1-4360-b580-5f24b4ca3e6e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:27.615783 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-0d142276-93c1-4360-b580-5f24b4ca3e6e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:27.623472 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-0d142276-93c1-4360-b580-5f24b4ca3e6e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1094 microversion: 2.1 time: 0.084011 Nov 24 18:33:27.624046 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 992/1983] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:27 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:28.641369 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-79d04c43-c66f-4064-a886-b68fa2c683d9 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:28.641979 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-79d04c43-c66f-4064-a886-b68fa2c683d9 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:28.711964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-79d04c43-c66f-4064-a886-b68fa2c683d9 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:28.719639 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-79d04c43-c66f-4064-a886-b68fa2c683d9 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1094 microversion: 2.1 time: 0.081932 Nov 24 18:33:28.720208 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 992/1984] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:28 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:29.737196 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-d82da9a2-ab39-418e-b3cc-1706164ed06c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:29.737800 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-d82da9a2-ab39-418e-b3cc-1706164ed06c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:29.910216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-d82da9a2-ab39-418e-b3cc-1706164ed06c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:29.917681 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-d82da9a2-ab39-418e-b3cc-1706164ed06c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1094 microversion: 2.1 time: 0.184538 Nov 24 18:33:29.918268 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 993/1985] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:29 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1094 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:30.933736 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9d31aabb-dbce-4a58-b61b-3a48fef16d37 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:30.934339 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9d31aabb-dbce-4a58-b61b-3a48fef16d37 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:31.004763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9d31aabb-dbce-4a58-b61b-3a48fef16d37 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:31.013332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9d31aabb-dbce-4a58-b61b-3a48fef16d37 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1094 microversion: 2.1 time: 0.083513 Nov 24 18:33:31.013894 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 993/1986] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:30 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:32.030436 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:32.031016 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:32.038352 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:32.038792 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:32.039542 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:32.039993 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:32.153402 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:32.161524 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-27632886-0f2d-4d09-8c8b-b716fc7053ad tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1144 microversion: 2.1 time: 0.135500 Nov 24 18:33:32.162063 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 994/1987] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:32 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:33.178523 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:33.179138 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:33.187963 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:33.188345 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:33.189125 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:33.189612 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:33.311509 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:33.320038 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9925d710-c2d7-47de-b81b-a14530f20635 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1210 microversion: 2.1 time: 0.145306 Nov 24 18:33:33.320640 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 994/1988] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:33 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:34.342722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:34.343320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:34.350325 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:34.350768 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:34.351528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:34.351982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:34.558592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:34.567071 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f95bce29-587f-475b-af48-fbc071e83ddb tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.228552 Nov 24 18:33:34.567858 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 995/1989] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:34 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:34.879107 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-0b6697b3-efd6-4854-a25c-cc3d308d94d9 req-2ce72b60-5e3c-4a9a-9fde-8d3bea2d7118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933485ba-9405-4063-a5ed-5103795622eb", "tag": "5c562205-eee7-4785-81fa-2db186948c8a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:33:34.881613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:33:34.881613 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:33:34.890697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-0b6697b3-efd6-4854-a25c-cc3d308d94d9 req-2ce72b60-5e3c-4a9a-9fde-8d3bea2d7118 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:34.891672 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-0b6697b3-efd6-4854-a25c-cc3d308d94d9 req-2ce72b60-5e3c-4a9a-9fde-8d3bea2d7118 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:34.909988 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-0b6697b3-efd6-4854-a25c-cc3d308d94d9 req-2ce72b60-5e3c-4a9a-9fde-8d3bea2d7118 service nova] Creating event network-changed:5c562205-eee7-4785-81fa-2db186948c8a for instance 933485ba-9405-4063-a5ed-5103795622eb on hv-cinder-81857 Nov 24 18:33:34.915100 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-0b6697b3-efd6-4854-a25c-cc3d308d94d9 req-2ce72b60-5e3c-4a9a-9fde-8d3bea2d7118 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041530 Nov 24 18:33:34.916133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 995/1990] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:33:35.584965 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:35.585566 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:35.593452 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:35.593905 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:35.594703 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:35.595139 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:35.788917 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:35.797322 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-64787c75-78c1-4724-aa03-b235d0a09aa4 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.216081 Nov 24 18:33:35.797879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 996/1991] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:35 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:36.814955 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:36.815657 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:36.823875 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:36.824526 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:36.825280 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:36.825709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:37.035410 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:37.044073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ded1280b-50d2-4141-b780-0395329ed138 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.233155 Nov 24 18:33:37.044620 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 996/1992] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:36 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:38.062148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:38.062750 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:38.069992 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:38.070437 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:38.071225 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:38.071689 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:38.267066 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:38.275122 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-eb2cff30-d189-470b-8dd9-418bd57fa050 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.216712 Nov 24 18:33:38.275688 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 997/1993] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:38 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:39.291077 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:39.292201 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:39.299364 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:39.299837 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:39.300625 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:39.301049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:39.507326 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:39.516683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-feab54f7-a1db-45ab-92bc-3b76ee1051de tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.229223 Nov 24 18:33:39.517236 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 997/1994] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:39 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:40.533148 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:40.533744 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:40.540861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:40.541297 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:40.544827 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:40.545269 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:40.746633 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:40.754765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-80ce2c7d-9581-4dff-ae9f-10fc21b4d0b0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.225143 Nov 24 18:33:40.755315 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 998/1995] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:40 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:41.771202 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:41.771805 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:41.779611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:41.780066 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:41.780814 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:41.781243 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:41.985747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:41.993744 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-0adb0b69-20fd-4ccd-84b2-0c7dd5f0871b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.226223 Nov 24 18:33:41.994301 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 998/1996] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:41 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:43.011216 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:43.011840 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:43.019018 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:43.019448 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:43.020249 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:43.020685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:43.222657 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:43.231024 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-21318f39-145c-4ea2-9ac2-965e29a2b12e tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.224050 Nov 24 18:33:43.231592 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 999/1997] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:43 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:44.249120 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:44.249667 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:44.256738 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:44.257182 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:44.258013 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:44.258449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:44.458783 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:44.467031 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f540e753-5061-4961-ba84-65c7a711628c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.222662 Nov 24 18:33:44.467585 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 999/1998] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:44 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:45.485008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:45.485549 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:45.492835 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:45.493285 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:45.494043 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:45.496636 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:45.693218 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:45.702320 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-484dc289-1f9b-4e90-af9c-8220aca9425b tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.221052 Nov 24 18:33:45.702861 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1000/1999] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:45 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:46.301906 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-3e73a31e-2acf-4887-8a27-fb521df41a56 req-d77b359f-b283-4293-8328-ee6657a786c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933485ba-9405-4063-a5ed-5103795622eb", "name": "network-vif-plugged", "status": "completed", "tag": "5c562205-eee7-4785-81fa-2db186948c8a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:33:46.303663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:33:46.303663 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:33:46.312294 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-3e73a31e-2acf-4887-8a27-fb521df41a56 req-d77b359f-b283-4293-8328-ee6657a786c6 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:46.312727 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-3e73a31e-2acf-4887-8a27-fb521df41a56 req-d77b359f-b283-4293-8328-ee6657a786c6 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:46.331057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-3e73a31e-2acf-4887-8a27-fb521df41a56 req-d77b359f-b283-4293-8328-ee6657a786c6 service nova] Creating event network-vif-plugged:5c562205-eee7-4785-81fa-2db186948c8a for instance 933485ba-9405-4063-a5ed-5103795622eb on hv-cinder-81857 Nov 24 18:33:46.335934 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-3e73a31e-2acf-4887-8a27-fb521df41a56 req-d77b359f-b283-4293-8328-ee6657a786c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157844 Nov 24 18:33:46.336515 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1000/2000] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:33:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:33:46.719244 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:46.719871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:46.726921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:46.727360 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:46.728143 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:46.728569 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:46.919742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:46.927765 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-ee926204-4828-4001-94f8-8a76df7cc659 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1266 microversion: 2.1 time: 0.212234 Nov 24 18:33:46.928563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1001/2001] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:46 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:33:47.945691 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:47.946383 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:47.954044 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:47.954519 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:47.955278 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:47.955739 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:48.147149 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:48.156004 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-e568d0ab-bd37-44b0-af28-d46fb644cec0 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1453 microversion: 2.1 time: 0.214365 Nov 24 18:33:48.156564 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1001/2002] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:47 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:48.171382 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:33:48.172025 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:33:48.179489 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:48.179970 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:48.180752 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:48.181179 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:48.375503 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:33:48.383645 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-961bbf88-7eec-4147-b958-169f187984bc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1453 microversion: 2.1 time: 0.215821 Nov 24 18:33:48.384204 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1002/2003] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:33:48 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:33:50.837536 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-f6416dea-c7cb-4a48-ad71-e62ac2bfdc9a req-994ce52f-4e59-452d-9b74-e1642eb42874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933485ba-9405-4063-a5ed-5103795622eb", "tag": "5c562205-eee7-4785-81fa-2db186948c8a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:33:50.839760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:33:50.839760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:33:50.847924 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-f6416dea-c7cb-4a48-ad71-e62ac2bfdc9a req-994ce52f-4e59-452d-9b74-e1642eb42874 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:33:50.848355 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-f6416dea-c7cb-4a48-ad71-e62ac2bfdc9a req-994ce52f-4e59-452d-9b74-e1642eb42874 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:33:50.864057 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-f6416dea-c7cb-4a48-ad71-e62ac2bfdc9a req-994ce52f-4e59-452d-9b74-e1642eb42874 service nova] Creating event network-changed:5c562205-eee7-4785-81fa-2db186948c8a for instance 933485ba-9405-4063-a5ed-5103795622eb on hv-cinder-81857 Nov 24 18:33:50.868849 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-f6416dea-c7cb-4a48-ad71-e62ac2bfdc9a req-994ce52f-4e59-452d-9b74-e1642eb42874 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088361 Nov 24 18:33:50.870179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1002/2004] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:33:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:34:12.616329 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:34:12.617006 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:34:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:35:37.184608 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1801684266", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-492530520", "security_groups": [{"name": "tempest-secgroup-smoke-2031811991"}], "block_device_mapping_v2": [{"uuid": "ea8b52b8-ac80-4efe-ae46-dd16551ea884", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43ed2dbe-8edd-4e75-a06b-5078acde0a2c"}]}} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:35:37.389735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.network.neutron [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] validate_networks() for [('43ed2dbe-8edd-4e75-a06b-5078acde0a2c', None, None, None)] {{(pid=100949) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Nov 24 18:35:38.021067 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 18:35:38.021479 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image limits 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 18:35:38.021944 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Flavor pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 18:35:38.022347 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Image pref 0:0:0 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 18:35:38.022747 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.virt.hardware [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=100949) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 18:35:38.031440 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:38.031909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:38.032695 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:38.033115 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:38.050104 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 18:35:38.054271 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.quota [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Getting quotas for user 6dda2a4913d343878c0e54cdcbddf6f4 and project cb19756ada554e398ec440fa707bd611. Resources: {'ram', 'cores', 'instances'} {{(pid=100949) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 18:35:38.151257 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Going to run 1 instances... {{(pid=100949) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Nov 24 18:35:38.153424 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea8b52b8-ac80-4efe-ae46-dd16551ea884',volume_size=None,volume_type=None)] {{(pid=100949) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Nov 24 18:35:38.320921 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8f38920c-7b69-402f-a9da-f7e853fe4380 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.140120 Nov 24 18:35:38.321687 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1003/2005] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 24 18:35:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 18:35:38.331020 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 24 18:35:38.334646 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-d249a89a-49df-4f74-8fa3-eb64ebb8bfed tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:38.335332 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-d249a89a-49df-4f74-8fa3-eb64ebb8bfed tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:38.454769 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-d249a89a-49df-4f74-8fa3-eb64ebb8bfed tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:38.462600 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-d249a89a-49df-4f74-8fa3-eb64ebb8bfed tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1094 microversion: 2.1 time: 0.134339 Nov 24 18:35:38.463145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1003/2006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:38 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:39.479941 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2108972d-2e26-43f5-86b1-0f3912680180 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:39.480546 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2108972d-2e26-43f5-86b1-0f3912680180 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:39.549562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2108972d-2e26-43f5-86b1-0f3912680180 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:39.557012 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2108972d-2e26-43f5-86b1-0f3912680180 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1094 microversion: 2.1 time: 0.081072 Nov 24 18:35:39.557562 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1004/2007] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:39 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:40.573428 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-a9c05e13-cf56-4474-a458-59ac50534f38 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:40.574034 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-a9c05e13-cf56-4474-a458-59ac50534f38 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:40.612534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] [6780fc2c-ad91-40f6-a4d4-640b19db8161] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 43392. Nov 24 18:35:40.660435 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-a9c05e13-cf56-4474-a458-59ac50534f38 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:40.668209 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-a9c05e13-cf56-4474-a458-59ac50534f38 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1094 microversion: 2.1 time: 0.098445 Nov 24 18:35:40.668763 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1004/2008] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:40 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:41.684821 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-8dd8b779-4e15-4a75-9079-ec7aed5d5df3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:41.685425 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-8dd8b779-4e15-4a75-9079-ec7aed5d5df3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:41.754735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-8dd8b779-4e15-4a75-9079-ec7aed5d5df3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:41.762236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-8dd8b779-4e15-4a75-9079-ec7aed5d5df3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1094 microversion: 2.1 time: 0.081053 Nov 24 18:35:41.762771 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1005/2009] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:41 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:42.778271 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:42.778891 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:42.787543 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:42.788099 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:42.788879 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:42.789330 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:42.922073 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:42.933148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-681dc609-684e-4542-b484-a67a255220b3 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1144 microversion: 2.1 time: 0.158518 Nov 24 18:35:42.933829 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1005/2010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:42 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1144 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:43.950665 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:43.951189 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:43.962180 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:43.962624 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:43.963396 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:43.963855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:44.080987 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:44.089467 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f1434748-54c5-47c8-9429-dc8423856dca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1210 microversion: 2.1 time: 0.142660 Nov 24 18:35:44.090031 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1006/2011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:43 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1210 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:45.106253 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:45.107347 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:45.115237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:45.115798 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:45.116645 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:45.117309 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:45.533952 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [req-e92d10b9-1d54-4a93-af1f-98ed07292955 req-502f06bb-f142-4039-83f8-bbcb29c959fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e542869-fd62-4f04-913f-677d62fdc25d", "tag": "632b998c-3e08-4782-8353-65907f10a123"}]} {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:35:45.537272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:35:45.537272 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: warnings.warn(msg) Nov 24 18:35:45.549254 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-e92d10b9-1d54-4a93-af1f-98ed07292955 req-502f06bb-f142-4039-83f8-bbcb29c959fd service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:45.550401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [req-e92d10b9-1d54-4a93-af1f-98ed07292955 req-502f06bb-f142-4039-83f8-bbcb29c959fd service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:45.576710 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.compute.server_external_events [req-e92d10b9-1d54-4a93-af1f-98ed07292955 req-502f06bb-f142-4039-83f8-bbcb29c959fd service nova] Creating event network-changed:632b998c-3e08-4782-8353-65907f10a123 for instance 0e542869-fd62-4f04-913f-677d62fdc25d on hv-cinder-81857 Nov 24 18:35:45.583772 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [req-e92d10b9-1d54-4a93-af1f-98ed07292955 req-502f06bb-f142-4039-83f8-bbcb29c959fd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060331 Nov 24 18:35:45.584857 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1007/2012] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:35:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:35:45.672375 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:45.681140 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5311bf51-3649-4695-9f97-24007d389eca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.578541 Nov 24 18:35:45.681700 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1006/2013] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:45 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:46.700408 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:46.701109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:46.709038 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:46.709490 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:46.710260 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:46.710697 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:46.911003 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:46.919575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-cf7ad5ff-d2fe-490c-9b33-203a1d519051 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.223148 Nov 24 18:35:46.920173 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1008/2014] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:46 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:47.935486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:47.936329 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:47.946118 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:47.946558 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:47.947500 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:47.947944 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:48.145399 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:48.153415 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-3371fa8c-77c7-49ac-9587-4237970eec1a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.221595 Nov 24 18:35:48.153956 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1007/2015] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:47 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:49.169880 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:49.170478 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:49.178282 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:49.178722 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:49.179760 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:49.180187 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:49.377484 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:49.385563 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-2d3ab933-aee7-4c76-b988-4c678f2356fe tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.219391 Nov 24 18:35:49.386112 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1009/2016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:49 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:49.494450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:35:49.494909 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:35:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:35:50.402678 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:50.403284 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:50.411023 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:50.411463 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:50.412275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:50.412710 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:50.612145 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:50.620179 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f64cfc6c-9ac6-4336-83e3-bbf95d004f8c tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.221194 Nov 24 18:35:50.620715 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1008/2017] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:50 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:51.637879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:51.638391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:51.645482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:51.645989 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:51.646841 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:51.647349 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:51.843117 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:51.852278 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-7ede618a-1118-48cc-a287-f03ea6b79991 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.218106 Nov 24 18:35:51.852822 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1010/2018] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:51 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:52.869074 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:52.869709 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:52.878052 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:52.878486 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:52.879240 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:52.879688 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:53.073786 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:53.081887 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-f2e66a80-6932-4fa3-a8af-37f83685297d tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.216455 Nov 24 18:35:53.082436 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1009/2019] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:52 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:54.098882 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:54.099485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:54.106778 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:54.107227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:54.108023 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:54.108459 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:54.298920 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:54.307227 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-9989f119-f57c-4db9-b789-fd3dc6e83b90 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.212668 Nov 24 18:35:54.307818 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1011/2020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:54 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:55.323880 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:55.324711 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:55.332577 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:55.333060 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:55.333827 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:55.334257 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:55.536477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:55.544482 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-9115b267-24fc-4c5d-95b3-8aa9681931dc tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.224240 Nov 24 18:35:55.545030 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1010/2021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:55 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:56.562358 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:56.562955 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:56.570759 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:56.571200 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:56.571980 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:56.572401 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:56.773579 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:56.782434 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aaf045bb-05de-4159-ad11-bd3261ed9269 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.223665 Nov 24 18:35:56.783009 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1012/2022] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:56 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:56.864677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-40fc03ba-300b-481d-aa70-0005e6c876b0 req-d068ea7b-25b2-4cbf-a094-0e4b4ffea107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e542869-fd62-4f04-913f-677d62fdc25d", "name": "network-vif-plugged", "status": "completed", "tag": "632b998c-3e08-4782-8353-65907f10a123"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:35:56.866438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:35:56.866438 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:35:56.874832 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-40fc03ba-300b-481d-aa70-0005e6c876b0 req-d068ea7b-25b2-4cbf-a094-0e4b4ffea107 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:56.875276 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-40fc03ba-300b-481d-aa70-0005e6c876b0 req-d068ea7b-25b2-4cbf-a094-0e4b4ffea107 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:56.890800 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-40fc03ba-300b-481d-aa70-0005e6c876b0 req-d068ea7b-25b2-4cbf-a094-0e4b4ffea107 service nova] Creating event network-vif-plugged:632b998c-3e08-4782-8353-65907f10a123 for instance 0e542869-fd62-4f04-913f-677d62fdc25d on hv-cinder-81857 Nov 24 18:35:56.895746 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-40fc03ba-300b-481d-aa70-0005e6c876b0 req-d068ea7b-25b2-4cbf-a094-0e4b4ffea107 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035634 Nov 24 18:35:56.896322 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1011/2023] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:35:57.800455 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:57.801085 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:57.808605 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:57.809040 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:57.809791 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:57.810213 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:58.011631 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:58.022109 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-aa33c4c3-f66e-4ba0-bec4-c69234e7b401 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1266 microversion: 2.1 time: 0.225849 Nov 24 18:35:58.022667 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1013/2024] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:57 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:35:59.041054 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:59.041685 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:59.050085 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:59.050531 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:59.051311 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:59.051751 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:59.285760 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:59.298137 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-52e7668e-d44a-4082-a7f6-b2d6e7c62e70 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1453 microversion: 2.1 time: 0.261436 Nov 24 18:35:59.299590 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1012/2025] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:59 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1453 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 18:35:59.320751 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:35:59.321228 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:35:59.332656 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:59.333091 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:59.339555 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:35:59.340008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:35:59.567102 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:35:59.577526 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-e790ed92-0ba2-4afa-8787-01ea72da1361 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1453 microversion: 2.1 time: 0.263868 Nov 24 18:35:59.578834 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1014/2026] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:35:59 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:36:01.959221 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-ca4c0932-72bc-4926-8830-907a95f0987c req-baf38ae7-17b6-4874-a7fc-030eafba6791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e542869-fd62-4f04-913f-677d62fdc25d", "tag": "632b998c-3e08-4782-8353-65907f10a123"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:36:01.961627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:36:01.961627 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:36:01.969734 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-ca4c0932-72bc-4926-8830-907a95f0987c req-baf38ae7-17b6-4874-a7fc-030eafba6791 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:36:01.970171 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-ca4c0932-72bc-4926-8830-907a95f0987c req-baf38ae7-17b6-4874-a7fc-030eafba6791 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:36:01.985770 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-ca4c0932-72bc-4926-8830-907a95f0987c req-baf38ae7-17b6-4874-a7fc-030eafba6791 service nova] Creating event network-changed:632b998c-3e08-4782-8353-65907f10a123 for instance 0e542869-fd62-4f04-913f-677d62fdc25d on hv-cinder-81857 Nov 24 18:36:01.990893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-ca4c0932-72bc-4926-8830-907a95f0987c req-baf38ae7-17b6-4874-a7fc-030eafba6791 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 Nov 24 18:36:01.991537 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1013/2027] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:36:02.580697 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:36:02.580905 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:36:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:36:34.600978 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:36:34.601544 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:36:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:37:32.067879 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 24 18:37:32.072650 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:32.073236 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:32.080937 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:32.081486 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:32.082305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:32.082817 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:32.154055 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-ed404865-a851-4f36-8682-6ecac8e30ffc req-08396710-a34f-4979-a530-6c94e29c0f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e542869-fd62-4f04-913f-677d62fdc25d", "tag": "632b998c-3e08-4782-8353-65907f10a123"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:37:32.155918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:37:32.155918 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:37:32.165477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-ed404865-a851-4f36-8682-6ecac8e30ffc req-08396710-a34f-4979-a530-6c94e29c0f11 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:32.165920 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-ed404865-a851-4f36-8682-6ecac8e30ffc req-08396710-a34f-4979-a530-6c94e29c0f11 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:32.169449 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:37:32.182649 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-ed404865-a851-4f36-8682-6ecac8e30ffc req-08396710-a34f-4979-a530-6c94e29c0f11 service nova] Creating event network-changed:632b998c-3e08-4782-8353-65907f10a123 for instance 0e542869-fd62-4f04-913f-677d62fdc25d on hv-cinder-81857 Nov 24 18:37:32.188049 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-ed404865-a851-4f36-8682-6ecac8e30ffc req-08396710-a34f-4979-a530-6c94e29c0f11 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118859 Nov 24 18:37:32.188842 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1014/2028] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:37:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:37:32.308165 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-f0612ab2-a6db-4764-a297-e9c954e0c4dd tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 204 len: 0 microversion: 2.1 time: 0.241090 Nov 24 18:37:32.308929 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1015/2029] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:37:32 2021] DELETE /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:37:32.317859 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:32.318540 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:32.326964 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:32.327416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:32.328246 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:32.328683 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:32.736144 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:32.745508 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-ed40c497-eaf8-4302-936f-f502a499ab49 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1577 microversion: 2.1 time: 0.432178 Nov 24 18:37:32.746275 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1015/2030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:32 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1577 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:33.767235 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:33.768062 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:33.788037 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:33.788655 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:33.789427 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:33.789855 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:33.845199 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] [1986ea7a-5ddd-44ef-a2c5-a071f1fb0213] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 43488. Nov 24 18:37:33.993101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:34.001348 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-3b6f9905-c6a5-4012-a65a-3af89d5e3a58 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1459 microversion: 2.1 time: 0.241095 Nov 24 18:37:34.001909 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1016/2031] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:33 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1459 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:34.964671 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-32279c3c-7636-4465-8dfd-b9acf45375d7 req-3c760d4d-359a-40b0-93be-e2fff9a1c3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e542869-fd62-4f04-913f-677d62fdc25d", "name": "network-vif-deleted", "tag": "632b998c-3e08-4782-8353-65907f10a123"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:37:34.966133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:37:34.966133 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:37:34.974931 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-32279c3c-7636-4465-8dfd-b9acf45375d7 req-3c760d4d-359a-40b0-93be-e2fff9a1c3d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:34.975416 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-32279c3c-7636-4465-8dfd-b9acf45375d7 req-3c760d4d-359a-40b0-93be-e2fff9a1c3d7 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:34.992677 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-32279c3c-7636-4465-8dfd-b9acf45375d7 req-3c760d4d-359a-40b0-93be-e2fff9a1c3d7 service nova] Creating event network-vif-deleted:632b998c-3e08-4782-8353-65907f10a123 for instance 0e542869-fd62-4f04-913f-677d62fdc25d on hv-cinder-81857 Nov 24 18:37:34.997281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-32279c3c-7636-4465-8dfd-b9acf45375d7 req-3c760d4d-359a-40b0-93be-e2fff9a1c3d7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036505 Nov 24 18:37:34.997861 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1016/2032] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:37:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 18:37:35.018685 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:35.019311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:35.026982 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:35.027443 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:35.028251 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:35.028682 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:35.149391 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:35.159250 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-c35d79a8-657e-4a68-8546-a1392f0dc3e5 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 200 len: 1225 microversion: 2.1 time: 0.144261 Nov 24 18:37:35.159890 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1017/2033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:35 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:36.177237 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:36.177853 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 0e542869-fd62-4f04-913f-677d62fdc25d] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:36.186296 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:36.186747 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:36.187512 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:36.187977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:36.238385 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] HTTP exception thrown: Instance 0e542869-fd62-4f04-913f-677d62fdc25d could not be found. Nov 24 18:37:36.238972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Returning 404 to user: Instance 0e542869-fd62-4f04-913f-677d62fdc25d could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:37:36.239806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-5037ad0b-b587-44f5-8aa6-6126db0d2523 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d" status: 404 len: 111 microversion: 2.1 time: 0.066880 Nov 24 18:37:36.240334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1017/2034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:36 2021] GET /compute/v2.1/servers/0e542869-fd62-4f04-913f-677d62fdc25d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:37:40.139962 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:40.140476 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:40.141960 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-e46e463f-34c8-4b9d-a103-3a3de96ec0ab req-f6fc657c-5ed9-4296-9f11-9fe8c7746b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933485ba-9405-4063-a5ed-5103795622eb", "tag": "5c562205-eee7-4785-81fa-2db186948c8a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:37:40.143668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:37:40.143668 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:37:40.147789 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:40.148415 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:40.149281 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:40.149927 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:40.152972 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e46e463f-34c8-4b9d-a103-3a3de96ec0ab req-f6fc657c-5ed9-4296-9f11-9fe8c7746b1a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:40.153477 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-e46e463f-34c8-4b9d-a103-3a3de96ec0ab req-f6fc657c-5ed9-4296-9f11-9fe8c7746b1a service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:40.171069 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-e46e463f-34c8-4b9d-a103-3a3de96ec0ab req-f6fc657c-5ed9-4296-9f11-9fe8c7746b1a service nova] Creating event network-changed:5c562205-eee7-4785-81fa-2db186948c8a for instance 933485ba-9405-4063-a5ed-5103795622eb on hv-cinder-81857 Nov 24 18:37:40.176542 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-e46e463f-34c8-4b9d-a103-3a3de96ec0ab req-f6fc657c-5ed9-4296-9f11-9fe8c7746b1a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037992 Nov 24 18:37:40.177370 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1018/2035] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:37:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:37:40.214528 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Going to try to terminate instance {{(pid=100949) delete /opt/stack/nova/nova/compute/api.py:2562}} Nov 24 18:37:40.332869 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b7a1d4df-53c0-4781-9821-f9b2ccef895a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 204 len: 0 microversion: 2.1 time: 0.196080 Nov 24 18:37:40.335684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1018/2036] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:37:40 2021] DELETE /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 18:37:40.343952 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:40.344651 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:40.352968 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:40.353425 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:40.354195 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:40.354630 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:40.760121 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.policy [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100948) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:40.769025 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-6cc1fc7a-339e-4ed3-b355-bd34d7dad0c6 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1577 microversion: 2.1 time: 0.429243 Nov 24 18:37:40.769594 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1019/2037] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:40 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1577 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:41.786910 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:41.787623 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:41.795344 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:41.795830 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:41.796581 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:41.797008 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:41.989492 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:41.997540 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-33bab604-b463-47fa-b07c-205a94811fe2 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1459 microversion: 2.1 time: 0.214717 Nov 24 18:37:41.998111 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1019/2038] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:41 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1459 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:42.869534 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [req-29828c08-5fb8-4fdd-9cf5-a0003a2f652d req-62be1def-5027-4530-9201-367d1ad0bba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933485ba-9405-4063-a5ed-5103795622eb", "name": "network-vif-deleted", "tag": "5c562205-eee7-4785-81fa-2db186948c8a"}]} {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 18:37:42.871148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 18:37:42.871148 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: warnings.warn(msg) Nov 24 18:37:42.879681 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-29828c08-5fb8-4fdd-9cf5-a0003a2f652d req-62be1def-5027-4530-9201-367d1ad0bba5 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:42.880097 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [req-29828c08-5fb8-4fdd-9cf5-a0003a2f652d req-62be1def-5027-4530-9201-367d1ad0bba5 service nova] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:42.896472 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.compute.server_external_events [req-29828c08-5fb8-4fdd-9cf5-a0003a2f652d req-62be1def-5027-4530-9201-367d1ad0bba5 service nova] Creating event network-vif-deleted:5c562205-eee7-4785-81fa-2db186948c8a for instance 933485ba-9405-4063-a5ed-5103795622eb on hv-cinder-81857 Nov 24 18:37:42.901110 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [req-29828c08-5fb8-4fdd-9cf5-a0003a2f652d req-62be1def-5027-4530-9201-367d1ad0bba5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035782 Nov 24 18:37:42.901701 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1020/2039] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 24 18:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 18:37:43.014299 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:43.014852 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:43.022138 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:43.022603 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:43.023367 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:43.023833 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:43.144904 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.policy [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dda2a4913d343878c0e54cdcbddf6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb19756ada554e398ec440fa707bd611', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=100949) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 18:37:43.155485 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-36c15b87-3879-4ea5-b987-dd49ae45c23a tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 200 len: 1225 microversion: 2.1 time: 0.145270 Nov 24 18:37:43.156095 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1020/2040] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:43 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 18:37:44.174450 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:44.175142 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: 933485ba-9405-4063-a5ed-5103795622eb] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:44.183893 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:44.184344 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:44.185172 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:44.185611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:44.240602 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] HTTP exception thrown: Instance 933485ba-9405-4063-a5ed-5103795622eb could not be found. Nov 24 18:37:44.241762 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Returning 404 to user: Instance 933485ba-9405-4063-a5ed-5103795622eb could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:37:44.243026 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-66e82a1c-fc84-4acb-abfb-04b26b6591ca tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb" status: 404 len: 111 microversion: 2.1 time: 0.072698 Nov 24 18:37:44.243557 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1021/2041] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:44 2021] GET /compute/v2.1/servers/933485ba-9405-4063-a5ed-5103795622eb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:37:45.115728 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:45.116340 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.compute.api [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100949) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:45.123871 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:45.124312 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:45.125061 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:45.125482 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG oslo_concurrency.lockutils [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:45.176735 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.wsgi [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] HTTP exception thrown: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. Nov 24 18:37:45.177311 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Returning 404 to user: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. {{(pid=100949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:37:45.178103 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-b11fdba2-c5f1-4eb2-ad58-4c470146db61 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 404 len: 111 microversion: 2.1 time: 0.066129 Nov 24 18:37:45.180649 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1021/2042] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Nov 24 18:37:45 2021] DELETE /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:37:45.188541 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '>' {{(pid=100948) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:45.189153 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.compute.api [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] [instance: c82ecc95-bc70-4016-a30b-2db492974044] Fetching instance by UUID {{(pid=100948) get /opt/stack/nova/nova/compute/api.py:2813}} Nov 24 18:37:45.196812 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:45.197263 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:45.198032 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 24 18:37:45.202449 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG oslo_concurrency.lockutils [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Lock "f2e45bcc-5d98-488c-8756-26bea03cb67a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100948) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 24 18:37:45.253611 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.wsgi [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] HTTP exception thrown: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. Nov 24 18:37:45.254158 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: DEBUG nova.api.openstack.wsgi [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Returning 404 to user: Instance c82ecc95-bc70-4016-a30b-2db492974044 could not be found. {{(pid=100948) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Nov 24 18:37:45.254977 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO nova.api.openstack.requestlog [None req-568eed71-b557-47e3-bbf3-9cbb8aa6f5df tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044" status: 404 len: 111 microversion: 2.1 time: 0.070113 Nov 24 18:37:45.255520 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: [pid: 100948|app: 0|req: 1022/2043] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Nov 24 18:37:45 2021] GET /compute/v2.1/servers/c82ecc95-bc70-4016-a30b-2db492974044 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 18:37:46.707742 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: DEBUG nova.api.openstack.wsgi [None req-bd6a1367-e04e-4648-940c-3cf6a9df1548 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] Calling method '.version_select at 0x7f8b10ae0700>' {{(pid=100949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 18:37:46.730013 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO nova.api.openstack.requestlog [None req-bd6a1367-e04e-4648-940c-3cf6a9df1548 tempest-TestVolumeBootPattern-862969102 tempest-TestVolumeBootPattern-862969102-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-492530520" status: 202 len: 0 microversion: 2.1 time: 0.025923 Nov 24 18:37:46.730575 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: [pid: 100949|app: 0|req: 1022/2044] 10.222.0.64 () {58 vars in 1259 bytes} [Wed Nov 24 18:37:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-492530520 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 18:39:09.511281 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:39:09.511843 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:39:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:39:22.600595 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:39:22.601224 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:39:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:40:52.638684 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:40:52.639305 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:40:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:29.529334 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:29.529806 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:42:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:42.618321 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:42.618935 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:42:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:47.784496 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:47.785101 dv-cinder-818579-1-iscsi devstack@n-api.service[100949]: Wed Nov 24 18:42:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 18:42:48.399040 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 18:42:48.399581 dv-cinder-818579-1-iscsi devstack@n-api.service[100948]: Wed Nov 24 18:42:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!